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Preface 


This text is s intéuded for: a fir st-yee ar ES raduate-level course c on 1 noulinear systems or | 
“control. It may also be used for self study or reference by enginecrs and applied | 
mathematicians. It is an outgrowth of my experience.teaching the nonlinear systems - 


course at Michigan State University. East Lansing. Students. taking this course have. - 


had. background i in electrical | engincering. mechanical engine 
ematics. The prerequisite for the ‘course is a graduate-level course in linear systems, 
taught at the level of the texts by Antsaklis and Michel [9], Chen [35], Kailath [94]. 
or Rugh [158]. The linear systems prerequisite allowed me not to worry about in- 
troducing the concept of "state" aud tu refer freely to "transfer functions,” "state 
transition matrices,” and other lincar system concepts. The mathematical back- 
ground is the usual level of calculus. differential equations, and matrix theory that. 
any graduate student in engineering or mathematics would have. In the Appendix, 
I have collected a few mathematical facts that are used throughout the book. 

 Ihave written the text in such a way tliat the level of mathematical sophistication 
increases as we advance from chapter to chapter. This is why the second chapter is 
written in an elementary context, Actually, this chapter could be taught at senior, 
or even junior, level courses witliout difficulty. This is also tlic reason I have split 
the treatinent. of Lyapunov stability iuto two parts. Iu Sections 4.1 through 4.3. 
I introduce the essence of Lyapuuov stability for autonomous systems where I do 
uot have to worry about technicalities such as uniformity, class K functions, etc. In 
Sections 4.4 through 4.6, I present Lyapunov stability in a more general setup that 
accommodates nonautonomous systems and allows for a deeper look into advanced 
aspects of the stability theory. The level of mathematical sophistication at the end 
of Chapter 4 is tle level to which I like to bring the students, so that they can 
coinfortably read the rest of the text. 

There is yet a higher level of mathematical sophistication that is assumed in 
writing the proofs in the Appendix. These proofs are not intended for classroom 
use. They are included to inake the text on one hand, self contained, and. ou the 
other, to respond to the need or desire of some students to read such proofs, such as 
students contimting on to couduct Ph.D. research into nonlinear systems or control 
theory. Those students cau continue to read the Appendix iu a self-study manner. 


This third edition has been written with the following goals in mind: 
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PREFACE 


1. To mākė the book (especially the early chapters) more accessible to first-year 


graduate students. As an example of the changes made toward that end, note 
the change in Chapter 3: All the material on mathematical background, the 
contraction mapping theorem, and the proof of the existence and uniqueness 
theorem have been moved to the Appendix. Several parts of the books have 
been rewritten to improve readability. 


. To reorganize the book in such a way that makes it easier to structure nonlin- 


ear systems or control courses around it. In the new organization, the book 
has four parts, as shown in the flow chart. A course on nonlinear systems anal- 
ysis will cover material from Parts 1, 2, and 3, while a course on nonlinear 
control will cover material from Parts 1, 2, and 4. 


Part 1 


Basic Analysis 


Chapters | to 4 


Part 2 
Analysis of Feedback Systems 


Chapters 5 to 7 


Part 4 
Nonlinear Feedback Control 


Chapters 12 to 14 


Part 3 


Advanced Analysis 


Chapters 8 to 11 


3. To update the material of the book to include topics or results that have 


proven to be useful in nonlinear control design in recent years. New to the 
third addition are the: expanded treatment of passivity and passivity-based 
control, integral control, sliding mode control, and high-gain observers. More- 
over, bifurcation is introduced in the context. of second-order systems. On the 
technical side, the reader will find Kurzweil’s converse Lyapunov theorem, 
nonlocal results in Chapters 10 and 11, and new results on integral control 
and gain scheduling. 


i 
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4. To update the exercises. More than 170 new exercises have been included. 


I am indebted to many colleagues, students, and readers, who helped me in 
writing the book, through discussions, suggestions, corrections, constructive com- 
ments, and feedback on the first two editions. There are, probably, more than 100 
names that I would like to acknowledge, but my fear of inadvertently omitting some 
names, leads to me settle for a big thank you to each one of you. 

I am grateful to Michigan State University for providing an environment that"al- 
lowed me to write this book, and to the National Science Foundation for supporting 
my research on nonlinear feedback control. 

The book was typeset using ETEX. All computations, including numerical so- 
lution of differentia] equations, were done using MATLAB and SIMULINK. The 
figures were generated using MATLAB or the graphics tool of PTEX. ^o 

As much as I wish the book to be free of errors, I know this will not be the case. 
Therefore, reports of errors, sent electronically to 


khalil@msu.edu 


will be greatly appreciated. An up-to-date errata list will be available at the home- 
page of the book: 


E www.egr.msu.edu / khalil/ NonlinearSystems 


The homepage also will contain a list of changes from the second edition, additional 
exercises, and other useful material. 


HASSAN KHALIL 
East Lansing, Michigan 
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Chapter 1 . 


Introduction 


When engineers analyze and design nonlinear dynamical systems in electrical cir- 
cuits, mechanical systems, coutrol systems, and other engineering disciplines, they 
need to absorb and digest à wide range of nonlinear analysis tools. In this book, we 
introduce some of the these tools. In particular, we present tools for the stability 
analysis of nonlinear systems, with emphasis on Lyapunov’s method. We give spe- 
cial attention to the stability of feedback systems from input-output and passivity 
perspectives. We present tools for the detection and analysis of "free" oscillations, 
including the describing function method. We introduce the asymptotic tools of 
perturbation theory, including averaging and singular perturbations. Finally, we 
introduce nonlinear feedback control tools, including linearization, gain scheduling, 
integral control, feedback linearization, sliding mode control, Lyapunov redesign, 
backstepping, passivity-based control, and high-gain observers. 


1.1 Nonlinear Models and Nonlinear Phenomena 


We will deal with dynamical systems that are modeled by a finite number of coupled 
first-order ordinary differential equations 


i = Rito. ma uisus Up) 
$9 = folt,r1,...,0n,U1,-..,Up) 
in = fa(t,21,...,0n,U1,-..,Up) 


where £; denotes the derivative of x; with respect to the time variable t and u1, u2, 
+++) Up are specified input variables. We call the variables z1, x2, ..., In the state 
variables. They represent the memory that the dynamical system has of its past. 
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| 


E 
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We usually use vector notation to write these equations in a compact fori. Define 


Xi s . filt,z,u) 

5 X2 fa(t, x,u) 
z=| i], 

Tn f(t, 2, %) 


and rewrite the n first-order differential equations as one n-dimensional first-order 


vector differential equation 
i = f(tz,u) * D (1.1) 


We call (1.1) the state equation and refer to x as the state and u as the input. 


Sometimes, another equation : 
y = A(t, 2, u) (1.2) 


is associated with (1.1), thereby defining a q-dimensional output vector y that com- 
prises variables of particular interest in the analysis of the dynamical system, (eg., 
variables that can be physically measured or variables that are required to behave in 
a specified manner). We call (1.2) the output equation and refer to equations (1.1) 
and (1.2) together as the state-space model, or simply the state model. Mathemat- 
ical models of finite-dimensional physical systems do not always come in the form 
of a state model. However, more often than not, we can model physical systems 
in this form by carefully choosing the state variables. Examples and exercises that 
will appear later in the chapter will demonstrate the versatility of the state model. 

A good part of our analysis in this book will deal with the state equation, many 
times without explicit presence of an input v, that is, the so-called unforced state 


equation 
t= f(t,z) (1.3) 


Working with an unforced state equation does not necessarily mean that the input 
to the system is zero. It could bé that the input has been specified as a given 
function of time, u = y(t), a given feedback function of the state, u = y(x), or 
both, u = 7(t,z). Substituting u = y in (1.1) eliminates u and yields an unforced 
state equation. i 7 

A special case of (1.3) arises when the function f does not depend explicitly on 
t; that is 
UIT & = f(z) (14) 
hich case the system is said to be autonomous or time invariant. 'The behavior 


in w nvaria 
om is invariant. to shifts iu the time origin, since clianging the 


of an autonomous syst 
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time variable from t to 7 = f — a docs not. change the right-hand side of the state 
equation. If the system is not autonomous, then it is called nonautonomous or time 
varying. ! 

Au important concept in dealing with the state equation is the concept of an 
equilibrium point. A point x = z" in the state space is said to be an equilibrium 
point of (1.3) if it has the property that whenever the state of the system starts at 
z^, it will remain at z* for all future time. For the autonomous system (1.4), the 
equilibrium points are the real roots of the equation 


f(x) =0 


An equilibrium point could be isolated; that is, there are no other equilibrium points 
in its vicinity, or there could be a continuuin of equilibrium points. ` 
For linear systems, the state model (1.1)-(1.2) takes the special form ` 


i = A(t)e+B(t)u 
y = C(t)z4 D(t)u 


We assume that the reader is familiar with the powerful analysis tools for linear 
systems, founded on the basis of the superposition principle. As we move from linear 
to nonlinear systems, we are faced with a more difficult situation. The superposi- 
tion principle does not hold any longer, and analysis tools involve more advanced 
mathematics. Because of the powerful tools we know for linear systems, the first 
step in analyzing a noulinear system is usually to linearize it, if possible, about 
some nominal operating point aud analyze the resulting linear model. This is a 
common practice in engineering, and it is a useful one. There is no question that, 
whenever possible, we should inake use of linearization to learn as much as we can 
about the behavior of a nonlinear system. However, linearization alone will not 
be sufficient; we must develop tools for the analysis of nonlinear systems. There 
are two basic limitations of linearization. First, since linearization is an approxi- 
mation in the neighborhood of an operating point, it can only predict the "local" 
behavior of the nonlinear system in the vicinity of that point. It cannot predict the 


“nonlocal” behavior far from the operating point and certainly not the “global” be- _ 


havior throughout the state space. Second, the dynamics of a nonlinear system are 
much richer than the dynamics of a linear system. There are “essentially nonlinear 
phenomena” that can take place only in the presence of nonlinearity, hence, they 
cannot be described or predicted by linear models. The following are examples of 


essentially norilinear phenomena: 


e Finite escape time. The state of an unstable linear system goes to infinity 
as time approaches infinity; a nonlinear system's state, however, can go to 
infinity in finite time. 


e Multiple isolated equilibria. A linear system can have only one isolated equi- 
libriun poiut: thus. it can have only one steady-state operating point that 
l 
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attracts the state of the system irrespective of the initial state. A nonlinear 
system can have more than one isolated equilibrium point. The state may 
converge to one of several steady-state operating points, depending on the 
initial state of the system. 


Limit cycles. For a linear time-invariant system to oscillate, it must have 
a pair of eigenvalues on the imaginary axis, which is a nonrobust condition 
that is almost impossible to maintain in the presence of perturbations. Even 
if we do, the amplitude of oscillation will be dependent on the initial state. 
In real life, stable oscillation must be produced by nonlinear systems. There 
are nonlinear systems that can go into an oscillation of fixed amplitude and 
frequency, irrespective of the initial state. This type of oscillation is known 
as a limit cycle. 


Subharmonic, harmonic, or almost-periodic oscillations. A stable linear sys- 
tem under a periodic input produces an output of the same frequency. A 
nonlinear system under periodic excitation can oscillate with frequencies that 


are submultiples or multiples of the:input frequency. It may even generate. -~= 


an almost-periodic oscillation, an example is the sum of periodic oscillations 
with frequencies that are not multiples of each other. 


e Chaos. A nonlinear system can have a more complicated steady-state behavior 
that is not equilibrium, periodic oscillation, or almost-periodic oscillation. 
Such behavior is usually referred to as chaos. Some of these chaotic motions 
exhibit randomness, despite the deterministic nature of the system. 


Multiple modes of behavior. It is not unusual for two or more modes of be- 
havior to be exhibited by the same nonlinear system. An unforced system 
may have more than one limit cycle. A forced system with periodic excita- 
tion may exhibit harmonic, subharmonic, or more complicated steady-state 
behavior, depending upon the amplitude and frequency of the input. It may 
even exhibit a discontinuous jump in the mode of behavior as the amplitude 
or frequency of the excitation is smoothly changed. 


In this book, we will encounter only the first three of these phenomena.! Multiple 
equilibria and limit cycles will be introduced in the next chapter, as we examine 
second-order autonomous systems, while the phenomenon of finite escape time will 
be introduced in Chapter 3. 


1To read about forced oscillation, chaos, bifurcation, and other important topics, the reader 
may consult [70], [74], [187], and [207]. 
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Figure 1.1: Pendulum. 


1.2 Examples 


1.2.1 Pendulum Equation 


Consider the simple pendulum shown in Figure 1.1, where | denotes the length of 
the rod and m denotes the mass of the bob. Assume the rod is rigid and has zero 
mass. Let 0 denote the angle subtended by the rod and the vertical axis through 
the pivot point. The pendulum is free to swing in the vertical plane. The bob of 
the pendulum moves in a circle of radius |. To write the equation of motion of 
the pendulum, let us identify the forces acting on the bob. There is a downward 
gravitational force equal to mg, where g is the acceleration due to gravity. There 
is also a frictional force resisting the motion, which we assume to be proportional 
to the speed of the bob with a coefficient of friction k. Using Newton's second law 
of motion, we can write the equation of motion in the tangential direction as 


ml = —mg sin 0 — kló 


Writing the equation of motion in the tangential direction has the advantage that 
the rod tension, which is in the normal direction, does not appear in the equation. 
We could have arrived at the same equation by writing the moment equation about 
the pivot point. To obtain a state model for the pendulum, let us take the state 
variables as 7; = @ and z2 = 0. Then, the state equations are 


$i = a (1.5) 
d = -$ singi -2a (1.6) 


To find the equilibrium points, we set 41 = t2 = 0 and solve for zı and ze: 


0 = zx 
0 
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The equilibrium points are located at (n7, 0), for n = 0, +1, €:2,.... From the phys- 
ical description of the pendulum, it is clear that the pendulum hes only two equi- 
librium positions corresponding to the equilibrium points (0,0) and (7,0). Other 
equilibrium points are repetitions of these two positions, which correspond to the 
number of full swings the pendulum would make before it rests at one of the two _ 
equilibrium positións. For example, if the pendulum makes m complete 360? revolu- 
tions before it rests at the downward vertical position, then, mathematically, we say 
that the pendulum approaches the equilibrium point (2m, 0). In our investigation 
of the pendulum, we will limit our attention to the two “nontrivial” equilibrium 
points at (0,0) and (7,0). Physically, we can see that these two equilibrium posi- 
_ tions are quite distinct from each other. While the pendulum can indeed rest at the 
(0,0) equilibrium point, it can hardly maintain rest at the (7,0) equilibrium point 
because infinitesimally small disturbance from that equilibrium will take the pen- 
‘dulum away. The difference between the two equilibrium points is in their stability 
properties, a topic we will study in some depth. 
Sometimes it is instructive to consider a version of the pendulum equation where 
the frictional resistance is neglected by setting k = 0. The resulting system 
i = t3 : (1.7) 

i i = - isinzi (1.8) 
is conservative-in the sense that if the pendulum is given an initial push, it will 
keep oscillating forever with a nondissipative energy exchange between kinetic and 
potential energies. This, of course, is not realistic, but gives insight into the behavior 
of the pendulum. It may also help in finding approximate solutions of the pendulum 
equation when the friction coefficient k is small. Another version of the pendulum 
equation arises if we can apply a torque T to the pendulum. This torque may be 
viewed as a control input in the equation 


(1.9) 


dj = ~ [sinz - LIA Lap (1.10) 

l m ml? 
Interestingly enough, several unrelated physical systems are modeled by equations 
similar to the pendulum equation. Such examples are the model of a synchronous 
generator connected to an infinite bus (Exercise 1.8), the model of.a Josephson 
junction circuit (Exercise 1.9), and the model of a phase-locked loop (Exercise 1.11). 


Consequently, the pendulum equation is of great practical importance, 


1.2.2 Tunnel-Diode Circuit 


Consider the tunnel-diode circuit shown in Figure 1.2,? where the tunnel diode is 
characterized by ig — h(vg). The energy-storing elements in this circuit are the 


2 Thin figure, ns well as Figures 1.3 and 1.7, are taken from [39]. 
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i, mA 


0.5 


0 0.5 1vVv 
(a) (b) 


Figure 1.2: (a) Tunnel-diode circuit; (b) Tunnel-diode vg-ig characteristic, 


capacitor C and the inductor L. Assuming they are linear and time invariant, we 
can model them by the equations 


; dug di, 
ic = CHL mp5 
| Cel MM IEEE 
where 4 and v are the current through and the voltage across an element, with the 
subscript specifying the element. To write a state model for the system, let us take 
€; = vc and x2 = iz as the state variables and u = E as a constant input. To write 
the state equation for x1, we need to express ic as a function of the state variables 


23,29 and the input u. Using Kirchhoff’s current law, we can write an equation 


that the algebraic sum of all currents leaving node © is equal to zero: 
ic+ir- iL =0 


Therefore, 
ic = —h(zi) T £9 


Similarly, we need to express v; as a function of the state variables z1, £2 and the 
input u. Using Kirchhoff's voltage law, we can write an equation that the algebraic 
sum of all voltages across elements in the left loop is equal to zero: 


w-E-TRiptvp-0 « : 


Hence, 
UL = -z — Rr + u 


We can now write the state model for the circuit as 
, 1 | 
à = c[-^(n) +29] (1.11) 


1 
$9 = L [2i = Razz + v] (1.12) 
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Figure 1.3: Equilibrium points of the tunnel-diode circuit. 


The equilibrium points of the system are determined by setting i; = tz = 0 and 
solving for xı and 2x9: 


= ~h(z1)+ z2 
0 = -zı — Rr +u 


Therefore, the equilibrium points correspond to the roots of the equation 


hlz) = Ë- zn , 

Figure 1.3 shows graphically that, for certain values of E and R, this equation has 
three isolated roots which correspond to three isolated equilibrium points of the 
system. The number of equilibrium points might change as the values of E and R 
change. For example, if we increase E for the same value of R, we will reach a point 
beyond which only the point Qs will exist. On the other hand, if we decrease E 
for the same value of R, we will end ùp with the point Q; as the only equilibrium. 
Suppose that we are in the multiple equilibria situation, which of these equilibrium 
points can we observe in an experimental setup of this circuit? The answer depends 
on the stability properties of the equilibrium points. We will come back to this 
example in Chapter 2 and answer the question. 


1.2.3  Mass-Spring System 


In the mass-spring mechanical system, shown in Figure 1.4, we consider a mass m 
sliding on a horizontal surface and attached to a vertical surface through a spring. 
The mass is subjected to an external force F. We define y as the displacement from 
a reference position and write Newtou’s law of motion 


mij + Fy + Fy =F 


| 
i 
1 
D 
i 
| 
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Figure 1.4: Mass-spring mechanical system. 


where F is a resistive force due to friction and F,, is the restoring force of the 
spring. We assume that Fep is a function only of the displacement y and write it as 
Fp = g(y). We assume also that the reference position has been chosen such that 
g(0) = 0. The external force F is at our disposal. Depending upon F, Fy, and g, 
several interesting autonomous and nonautonomous second-order models arise. 

For a relatively small displacement, the restoring force of the spring can be 
modeled as a linear function g(y) = ky, where k is the spring constant. For a 
large displacement, however, the restoring force may depend nonlinearly on y. For 
example, the function . 


n gly) =k(1-ay’)y, lay| « 1 


models the so-called softening spring, where, beyond a certain displacement, a large 
displacement increment produces a small force increment. On the other hand, the 
function 

9(y) = ka  o*y?)y 
models the so-called hardening spring, where, beyond a certain displacement, a 
small displacement increment produces a large force increment. 

The resistive force Fy may have components due to static, Coulomb, and viscous 
friction. When the mass is at rest, there is a static friction force F, that acts parallel 
to the surface and is limited to umg, where 0 < us < 1 is the static friction 
coefficient. This force takes whatever value, between its limits, to keep the mass at 
rest. For motion to begin, there must be a force acting on the mass to overcome 
the resistance to motion caused by static friction. In the absence of an external 
force, F = 0, the static friction force will balance the restoring force of the spring 
and maintain equilibrium for [g(y)| € u4mg. Once motion has started, the resistive 
force Fj, which acts in the direction opposite to motion, is modeled as a function 
of the sliding velocity v = y. The resistive force due to Coulomb friction Fe has a 
constant magnitude amg, where pz is the kinetic friction coefficient, that is, 


—u,ymg, for v«0 
kmg, for v»0 


As the mass moves in a viscous medium, such as air or lubricant, there will be 
a frictional force due to viscosity. This force is usually modeled as a nonlinear 


A GREASE T 
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(b) 


(c) (d) 


Figure 1.5: Examples of friction models. (a) Coulomb friction; (b) Coulomb plus linear 
viscous friction; (c) static, Coulomb, and linear viscous friction; (d) static, Coulomb, 
and linear viscous friction—Stribeck effect. 


function of the velocity; that is, F, = h(v), where 4(0) = 0. For-small velocity, 
we can assume that F, = cv. Figures 1.5(a) and (b) show examples of friction 
models for Coulomb friction and-Coulombs plus linear viscous friction, respectively. 
Figure 1.5(c) shows an example where the static friction is higher than the level of 
Coulomb friction, while Figure 1.5(d) shows a similar situation, but with the force 
decreasing continuously with increasing velocity, the so-called Stribeck effect. 
The combination of a hardening spring, linear viscous friction, and a periodic 
external force F = Acoswt results in the Duffing’s equation 


mij + cj + ky + ka?y? = Acoswt (1.13) 
which is a classical example in the study of periodic excitation of nonlinear systems. 
The combination of a linear spring, static friction, Coulomb friction, linear vis- 


cous friction, and zero external force results in 


mi + ky * cj  n(y. y) = 0 


iit este: omen er waren Naa erent Hest aes ime PLE Rd 
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where 


emg sign(y), for |y|» 0 
ny.y) = 4 -ky for y=0 and [y| X u,mg/k 
—psmg sign(y), for y=0 and |y] > usmg/k 


The value of n(y, ý) for j = 0 and |y| S u4mg/k is obtained froin the equilibrium 
condition j = y = 0. With zı = y and z2 = 9, the state model is 


ij = T2 (1.14) 

: k c 1 

i = = t c qae ain za) (1.15) 
Let us note two features of this state model. First, it has an equilibrium set, 
rather than isolated equilibrium points. Second, the right-hand side function is 
a discontinuous function of the state. The discontinuity is a consequence of the 
idealization we adopted in modeling friction. One would expect the physical friction 
to change from its static friction mode into its sliding friction mode in a smooth way, 
not abruptly as our idealization suggests.) The discontinuous idealization, however, : 
simplifies the analysis. For example, when x2 > 0, we can model the system by the 
linear model i 


ii = 22 
k 


: c 
T2 = 0 —o—Xi-— —ZI2 — Kk 
m pm HKI 


Similarly, when x2 < 0, we can model it by the linear model 
ij = I2 


$2 = ES T ui 
2 = m um Ug 


Thus, in each region, we can predict the behavior of the system via linear analysis. 
This is an example of the so-called piecewise linear analysis, where a system is 
represented by linear models in various regions of the state space, certain coefficients 
changing from region to region. 


1.2.4 Negative-Resistance Oscillator 


Figure 1.6 shows the basic circuit structure of an important class of electronic 
oscillators. The inductor and capacitor are assumed to be linear, time invariant 
and passive, that is, L > 0 and C > 0. The resistive element is an active circuit 
characterized by the v-i characteristic i = h(v), shown in the figure, The function 


3The smooth transition from static to sliding friction can be captured by dynamic friction 
models; see, for example, [12] and [144]. 
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Figure 1.22: Exercise 1.13. 


Figure 1.23: Exercise 1.14. 


1.15 Consider the inverted pendulum of Figure 1.24 [110]. The pivot of the pen- 
dulum is mounted on a cart that can move in a horizontal direction. The cart is 
driven by a motor that exerts a horizontal force F on the cart. The figure shows also 
the forces acting on the pendulum, which are the force mg at the center of gravity, 
‘a horizontal reaction force H, ancl a vertical reaction force V at the pivot. Writ- 
ing horizontal and vertical Newton's laws at the center of gravity of the pendulum 


yields 2 
m E c-Lsn0)- H and m mu cos) = V —mg 
Taking moments about the center of gravity yields the torque equation 


16 = VLsin0 ~ HLcos6 
while a horizontal Newton’s law for the cart yields 
My =F -H -ký 


Here m is the mass of the pendulum, M is the mass of tlie cart, L is the distance 
from the center of gravity to the pivot, J is the moment of inertia of the pendulum 
with respect to the center of gravity, k is a friction coefficient, y is the displacement 
of the pivot, @ is the angular rotation of the pendulum (measured clockwise), and 
g is the acceleration due to gravity. l 


(a) Carrying out the indicated differentiation and eliminating V and H, show that 
the equations of motion reduce to 


16 = mgLsin6 — mL?à — mLij cost 
Mj-F-m (i + Licos@ — L9? sing) -k 
(b) Solving the foregoing equations for 6 aud jj, show that 


6] 1 m+M "—mLcos0 
j| A(0)| mLcost ‘I+mL? 


mgL sin 0 
F + mL8? sinb — ky 


-T 
| 
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Pendulum 


Cart F 


Figure 1.24: Inverted pendulum of Exercise 1.15. 


where 


A(0) = (I+ mL?)(m+ M) - ? cos? 0 > (I +mL?)M - m1 20 
(c) Using z1 = 0, z2 = 6, z3 = y, and z4 = j as the state variables and u = F as 
the control input, write down the state equation. 


1.16 Figure 1.25 shows a schematic diagram of a Translational Oscillator with 
Rotating Actuator (TORA) system [205). The system consists of a platform of 
mass M connected to a fixed frame of reference by a linear spring, with spring 
constant k. The platform can only move in the horizontal plane, parallel to the 
spring axis. On the platform, a rotating proof mass is actuated by a DC motor. 
It has mass m and moment of inertial J around its center of mass, located at a 
distance L from its rotational axis. The control torque applied to the proof mass 
is denoted by u. The rotating proof mass creates a force which can be controlled 
to dampen the translational motion of the platform. We will derive a model for 
the system, neglecting friction. Figure 1.25 shows that the proof mass is subject to 
forces F; and F, and a torque u. Writing Newton's law at the center of mass and 
taking moments about the center of mass yield the equations 


2 
m ger Lind) = Fz, m d S (Lcos) = Fy, and IÓ = u4- FyL sinó— F;L cos 


where @ is the angular position of the proof mass (measured counter clockwise). 


"The platform is subject to the forces F, and Fy, in the opposite directions, as well 


as the restoring force of the spring. Newton's law for the platform yields 
M = —Fz — ka, 


where ze is the translational position of the platform. 
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(a) Carrying out the indicated differentiation and eliminating F, and Fy, show 
that the equations of motion reduce to 


8] [. u I+mL? mL cosé 
ue) | Ëe | z | mL? sin — kze | pRiESDUM S | mLcos M+m | 


(b) Solving the foregoing equation for Ó and že, show that 
HE m+M Te ou | 
Ëe A(8) | -mL cos I+ mL? mL? sin — kze 
where 
A(0) = (I+ mL?)(m + M) — m^ I? cos? 0 > (I - mL?)M - mI >0 


(c) Using z1 = 0, z2 = 6, 23 = £e, and T4 = Że as the state variables and u as the 
control input, write down the state equation. 


(d) Find all equilibrium points of the system. 


Figure 1.25: Translational Oscillator with Rotating Actuator (TORA) system. 


1.17 The dynamics of a DC motor [178] can be described by 


` di 
vy = Rrig + Ly 
dia 
Ta = ero + La— dt 2 4+ Raia 
jæ = ipia — 
di = 21f1a — C3W 


The first equation is for the field circuit with vr, iy, Rr, and Ly being its voltage, ` 
current, resistance, and inductance. The variables va, ta, Ra, and La are the corre- 
sponding variables for the armature circuit described by the second equation. The 
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third equation is a torque equation for the shaft, with J as the rotor inertia and c; 
as a damping cocíficieut. The term cj ju is the back e.m.f. induced in the armature 


circuit, and cgi sia is the torque produced by the interaction of the armature current 
with the field circuit flux. 


a) For a separately excited DC motor, the voltages va and vy are independent 
f 
control inputs. Choose appropriate state variables and find the state equation. 


(b) Specialize the state equation of part(a) to the field controlled DC motor, where 
vy is the control input, while va is held constant. 


(c) Specialize the state equation of part(a) to the armature controlled DC motor, 


where v, is the control input, while vy is held constant. Can you reduce the 
order of the model in this case? 


(d) In a shunt wound DC motor, the field and armature windings are connected 
in parallel and an external resistance Ry is connected in series with the field 
winding to limit the field flux; that is, v = va = vg + Rats. With v as the 
control input, write down the state equation. 


1.18 Figure 1.26 shows a schematic diagram of a magnetic suspension system, 
where & ball of magnetic material is suspended by means of an electromagnet whose 
current is controlled by feedback from the, optically measured, ball position [211, 
pp. 192-200). This system has the basic ingredients of systems constructed to 
levitate mass, used in gyroscopes, accelerometers, and fast trains. The equation of 
motion of the ball is 

mij = —ky + mg + Fly, i) 


where m is the mass of the ball, y > 0 is the vertical (downward) position of the 
ball measured from a reference point (y = 0 when the ball is next to the coil), k is 
a viscous friction coefficient, g is the acceleration due to gravity, F(y, i) is the force 
generated by the electromagnet, and i is its electric current. The inductance of the 
electromagnet depends on the position of the ball and can be modeled as 


L L 

(v ydo cad 1+ s 
where L4, Lo, and a are positive constants. This model represents the case that the 
inductance has its highest value when the ball is next to the coi] and decreases to 
a constant value as the ball is removed to y = oo. With E(y,i) = lL(y)i? as the 
energy stored in the electromagnet, the force F(y, i) is given by 


„_ 3E _ Loi? 
Flui) = Oy  2a(1+y/a)}? 


When the electric circuit of the coil is driven by a voltage source with voltage v, 


. Kirchhoff's voltage law gives the relationship v = $+ Ri, whore R is the serios 


resistance of the circuit and @ = L(y)i is the magnetic flux linkage. 
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Controller 


MESES 


OR 


source 
Figure 1.26: Magnetic suspension system of Exercise 1.18. 


(a) Using x; = y, z2 = y, and z3 = i as state variables and u = v as control input, 
find the state equation. 


(b) Suppose it is desired to balance the ball at a certain position r > 0. Find the 
steady-state values Iss and V,, of i and v, respectively, which are necessary 
to maintain such balance. 


The next tliree exercises give examples of hydraulic systems [41]. 


1.19 Figure 1.27 shows a hydraulic system where liquid is stored in an open tank. 
The cross-sectional area of the tank, A(A), is a function of h, the height of the liquid 
level above the bottom of the tank. The liquid volume v is given by v — " A(A) dA. 
For a liquid of density p, the absolute pressure p is given by p = pgh + pa, where 
Pa is the atmospheric pressure (assumed constant) and g is the acceleration due 
to gravity. The tank receives liquid at a flow rate w; and loses liquid through a 
valve that obeys the flow-pressure relationship wo = kvp. In the current case, 
Ap = p — pa. Take u = wj to be the control input and y = h to be the output. 


(a) Using h as the state variable, determine the state model. 
(b) Using p — pa as the state variable, determine the state model. 


(c) Find uss that is needed to maintain the output at a constant value r. 


1.20 The hydraulic system shown in Figure 1.28 consists of a constant speed cen- 
trifugal pump feeding a tank from which liquid flows through a pipe and a valve that 
obeys the relationship wo = kp — pa. The pump characteristic for the specified 
pump speed is shown in Figure 1.29. Let us denote this relationship by Ap = ó(wi) 
and denote its inverse, whenever defined, by w: = $^! (Ap). For the current pump, 
Ap = p —pa. The cross-sectional area of the tank is uniform; therefore, v = Ah and 
p = pa + pgv/A, where the variables are defined in the previous exercise. 
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Figure 1.27: Exercise 1.19. Figure 1.28: Exercise 1.20. 


Ap 


w 


Figure 1.29: Typical centrifugal pump characteristic. 


(a) Using (p — pa) as the state variable, find the state model. 
(b) Find all equilibrium points of the system. 


1.21 The valves in the hydraulic system of Figure 1.30 obey the flów relationships 
Wi = ky pi — pa and we = ks /p3 — pa. The pump.has the characteristic shown 
in Figure 1.29 for (p; — pa) versus wy. The various components and variables are 
defined in the previous two exercises. i 


(a) Using (pı — pa) and (pa — pa) as the state variables, find the state equation. 
(b) Find all equilibrium points of the system. 


" 
1.22 Consider a biochemical reactor with two components— biomass and substrate— 
where the biomass cells consume the substrate [23]; a schematic is shown in Fig- 
ure 1.31. Assume that the reactor is perfectly mixed and the volume V is constant. 
Let xı and z2 be the concentrations (mass/volume) of the biomass cells and sub- 
strate, respectively, and z,; and x2, be the corresponding concentrations in the 
feed stream. Let rı be the rate of biomass cell generation (mass/volume/time), r2 
be the rate of the substrate consumption, and F be the flow rate (volume/time). 


The dynamic model is developed by writing material balances on the biomass and 
substrate; that is, 


rate of biomass accumulation = in by flow — out by flow + generation 


H 
$ 
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Figure 1.30: The hydraulic system of Exercise 1.21. 


rate of substrate accumulation — in by flow — out by flow — consumption 


The generation rate r, is modeled as rı = x1, where the specific growth coefficient 
H is a function of z2. We assume that there is no biomass in the feed Stream, so 
7,5 = 0, the dilution rate d = F/V is constant, and the yield Y = r;/rz is constant. 


(a) Using zı and zz as state variables, find the state model. 


(b) Find all equilibrium points when p = ug z2/ (ks + z2) for some positive con- 
stants u,, and km. Assume that d < um. 


(c) Find all equilibrium points when p = uiz2/ (km +22 + kız2) for some positive 
constants Jm, km, and kı. Assume that d < max;,»o(u(z2)) 
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Figure 1.31: Biochemical reactor of Exercise 1.22, 


Chapter 2 


Second-Order Systems 


Second-order autonomous systems occupy an important place in the study of non- 
linear systems because solution trajectories can be represented by curves in the 
plane. This allows for easy visualization of the qualitative behavior of the system. 
The purpose of this chapter is to use second-order systems to introduce, in an ele- 
mentary context, some of the basic ideas of nonlinear systems. In particular, we will 
look at the behavior of a nonlinear system near equilibrium points, the phenomenon 
of nonlinear oscillation, and bifurcation. 

A second-order autonomous system is represented by two scalar differential equa- 
tious 


ii Ri (z1, 22) (2.1) 


fa(z1, 22) (2.2) 


Let x(t) = (z1(t), z2(t)) be the solution? of (2.1)-(2.2) that starts at a certain initial 
State zo = (£10, T20); that is, z(0) = xo. The locus in the z;—r2 plane of the solution 
x(t) for all ¢ > 0 is a curve that passes through the point xg. This curve is called 
a trajectory or orbit of (2.1)-(2.2) from zy. The 21-22 plane is usually called the 
state plane or phase plane. The right-hand side of (2.1)-(2.2) expresses the tangent 
vector £(t) = (41(t), t2(t)) to the curve. Using the vector notation 


t= f(a) 


where f(x) is the vector (f1(x), f2(z)). we consider f(x) as a vector field on the 
state plane, which means that to each point z in the plane, we assign a vector f(z). 
For easy visualization, we represent f(x) as a vector based at z; that is, we assign 
to x the directed line segment from z to x+ f(x). For example, if f(z) = (222,22). 
then at x = (1,1), we draw an arrow pointing from (1, 1) to (1,1) + (2, 1) = (3, 2). 
(See Figure 2.1.) Repeating this at every point in a grid covering the plane, we 
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1J¢ is assumed that there is a unique solution. 
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T2 


Tj 


Figure 2.1: Vector field representation. 


obtain a vector field diagram, such as the one shown in Figure 2.2 for the pendulum 
equation without friction: . 


d$) = t 
i93 =  —lÜsinz; 


In the figure, the length of the arrow at a given point x is proportional to the 
length of f(x), that is, y f?(x) + f2(r). Sometimes, for convenience, we draw 
arrows of equal length at all points. Since the vector field at a point is tangent to 
the trajectory through that point, we can, in essence, construct trajectories from 
the vector field diagram. Starting at a given initial point zo, we can construct the 
trajectory from zo by moving along the vector field at zo. This motion takes us to 
a new point Za, where we continue the trajectory along the vector field at za. If the 
process is repeated carefully and the consecutive points are chosen close enough to 
each other, we can obtain a reasonable approximation of the trajectory through zo. 
In the case of Figure 2.2, a careful implementation of the foregoing process would 
show that the trajectory through (2, 0) is a closed curve. 


The family of all trajectories or solution curves is called the phase portrait of 
(2.1)-(2.2). An (approximate) picture of the phase portrait can be constructed 
by plotting trajectories from a large number of initial states spread all over the 
rj-r9 plane. Since numerical subroutines for solving general nonlinear differential 
equations are widely available, we can easily construct tlie phase portrait by using 
computer simulations. (Some hints are given in Section 2.5.) Note that since 
the time t is suppressed in a trajectory, it is not possible to recover the solution 
(z1(t), x2(t)) associated with a given trajectory. Hence, a trajectory gives only the 
qualitative, but not quantitative, behavior of the associated solution. For example, 
a closed trajectory shows that there is a periodic solution; that is, the system has 
a sustained oscillation, whereas a shrinking spiral shows a decaying oscillation. In 
the rest. of this chapter, we will qualitatively analyze the behavior of second-order 
systems by usiug their phase portraits. 
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Figure 2.2: Vector field diagram of the pendulum equation without friction. 


2.1 Qualitative Behavior of Linear Systems 


Consider the linear time-invariant system 
t= Ar (2.3) 


where A is a 2 x 2 real matrix. The solution of (2.3) for a given initial state xg is 
given by 


a(t) = M exp(J,t)M- lag 


where J, is the real Jordan form of A and A is a real nonsingular matrix such that 


M-AM = J,. Depending on the eigenvalues of A, the real Jordan form may take 
one of three forms 


à 0 à k a — 
[o xp [oa] m [2 7] 
where k is either 0 or 1. The first form corresponds to the case when the eigenval- 
ues A; and Ag are real and distinct, the second form corresponds to the case when 
the eigenvalues are real and equal, and the third form corresponds to the case of 
complex eigenvalues 41,5 = a + jf. In our analysis, we have to distinguish between 
these three cases. Moreover, with real eigenvalues, we have to isolate the case when 
at least one of the eigenvalues is zero. In that situation, the origin is not an isolated 


equilibrium point and the qualitative behavior is quite different from the behavior 
in the other cases. 


4 
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Case 1. Both eigenvalues are real: A, # à; # 0. 


In this case, M = [vivo], where v and vz are the real eigenvectors associated 
with A; and A. The change of coordinates z = M ^!z transforms the system into 
two decoupled first-order differential equations, 


A-—AÀ, 29 = A222 


whose solution, for a given initial state (210, 229), is given by 


zi(t) = ze,  za(t) = z206% 
Eliminating t between the two equations, we obtain 
22— cz]! (2.4) 


where c = z99/(z19)*2/*!. The phase portrait of the system is given by the family 
of curves generated from (2.4) by allowing the constant c to take arbitrary values 
in R. The shape of the phase portrait depends on the signs of 4 and As. 

Consider first the case when both eigenvalues are negative. Without loss of 
generality, let 4; < A1 < 0. Here, both exponential terms e^!* and e^* tend to zero 
as t — co. Moreover, since A < À, < 0, the term eò? tends to zero faster than 
the term eùt, Hence, we call Àz the fast eigenvalue and A, the slow eigenvalue. 
For later reference, we call vz the fast eigenvector and v; the slow eigenvector. The 
trajectory tends to the origin of the 2;—22 plane along the curve of (2.4), which now 
has a ratio À2/A1 that is greater than one. The slope of the curve is given by 


dz; da [(A2/à1)-1] 
da X 


Since [(42/A1) — 1] is positive, the slope of the curve approaches zero as |z;| — 0 
and approaches oo as |z;| — co. Therefore, as the trajectory approaches the origin, 
it becomes tangent to the z;-axis; as it approaches oo, it becomes parallel to the 
z9-Bxis. These observations allow us to sketch the typical family of trajectories 
shown in Figure 2.3. When transformed back into the z-coordinates, the family 
of trajectories will have the typical portrait shown in Figure 2.4(a). Note that in 
the 24-22 plane, the trajectories become tangent to the slow eigenvector v; as they 
approach the origin and parallel to the fast eigenvector vz far from the origin. In 
this situation, the equilibrium point z = 0 is called a stable node. 

When A, and As are positive, the phase portrait will retain the character of Fig- 
ure 2.4(a), but with the trajectory directions reversed, since the exponential terms 
eùt and e^! grow exponentially as t increases. Figure 2.4(b) shows the phase por- 
trait for the case Àz > Ay > 0. The equilibrium point x = 0 is referred to in this 
instance as an unstable node. 
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Figure 2.3: Phase portrait of a stable node in modal coordinates. 


Figure 2.4: Phase portraits for (a) a stable node; (b) an unstable node. 


Suppose now that the eigenvalues have opposite signs. In particular, let 4; < 0 < 
A1. In this case, e™t — co, while e* — 0 as t + oo. Hence, we call Az the stable 
eigenvalue and A, the unstable eigenvalue. Correspondingly, vz and v; are called the 
stable and unstable eigenvectors, respectively. Equation (2.4) will have a negative 
exponent (A2/A;). Thus, the family of trajectories in the 2;-22 plane will take the 
typical form shown in Figure 2.5(a). Trajectories have hyperbolic shapes. They 


‘become tangent to the z;-axis as |z;| — oo and tangent to the z2-axis as |z,| — 0. 


The only exception to these hyperbolic shapes are the four trajectories along the 


axes. The two trajectories along the z-axis are called the stable trajectories since 


they approach the origin as £ — oo, while the two trajectories along the 2;-axis are 
called the unstable trajectories since they approach infinity as t — oo. The phase 
portrait in the z;-z2 plane is shown in Figure 2.5(b). Here the stable trajectories are 
along the stable eigenvector v? and the unstable trajectories are along the unstable 
eigenvector vı. In this case, the equilibrium point is called a saddle. 
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(b) 


Figure 2.5: Phase portrait of a saddle point (a) in modal coordinates; (b) in original 
coordinates. 
‘Case 2. Complex eigenvalues: 21,2 = a + jf. 
The change of coordinates z = M 7!z transforms the system (2.3) into the form 
2, = 021-822, 4g = Bz) +02 


The solution of these equations is oscillatory and can be expressed more conveniently 
in the polar coordinates 


/ 2 -1( 22 
r= 4/22 422, 0 = tan zr 


where we have two uncoupled first-order differential equations: 
?—ar and 6=f 
The solution for a given initial state (rg, ĝo) is given by 
r(t) — rge?* and (t) = 6o + Bt 


ing o f o, 

which define a logarithmic spiral in the z1-z plane. Vicus $ a uni 2 : 

i i f the three forms shown in Figure 2.6. V <0, 

the trajectory will take one o own ae ae 
i rigin; when a > 0, it diverges away fro i 

the spiral converges to the origin; w : ^ ep 

j is a circ e 2.7 shows the trajec 
= 0, the trajectory is a circle of radius ro. Figur 8 
" ae pee plane. The equilibrium point x = 0 is referred to as a stable focus if 
a <0, unstable focus if a > 0, and center if a = 0. 
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Figure 2.6: Typical trajectories in the case of complex eigenvalues, 


(a) a «0; (b) a» 0; (c) a 2 0. 
x 
ik 55 o "? 
X4 X4 


Figure 2.7: Phase portraits for (a) a stable focus; (b) an unstable focus; (c) a center, 


Case 3. Nonzero multiple eigenvalues; à= A= 


The change of coordinates z = M^7!z transforms the system (2.3) into the form 
; Ai- Az kzo, i9 = ÀZ2 
whose solution, for a given initial state (216, 220), is given by 


zı (t) = e(219 + kzgot), zo(t) = e", 


Eliminating t, we obtain the trajectory equation 


210 k «92 
2625 | 29. [S25 
Cabe E d e (2) 


Figure 2.8 shows the form of the trajectories when k = 0, while Figure 2.9 shows 
their form when k = 1. The phase portrait has some similarity with the portrait 
of a node, Therefore, the equilibrium point z = 0 is usually referred to as a stable 
node if À < 0 and unstable node if à > 0. Note, however, that the phase portraits 
of Figures 2.8 and 2.9 do not have the asymptotic slow-fast behavior that we saw 
in Figures 2.3 and 2.4. 

Before we discuss the degenerate case when one o 
zero, let us summarize our findings about the qualitative behavior of the system 
when the equilibrium point z — 0 ís isolated. We have seen that the system can dis- 


play six qualitatively different phase portraits, which are associated with different 
© 


r both of the eigenvalues are 
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7o 
a 
(a) (b) - 


Figure 2.8: Phase portraits for the case of nonzero multiple eigenvalues when k = 0: 
(a) À < 0; (b) A» 0. 


22 


(a) (b) 


Figure 2.9: Phase portraits for the case of nonzero multiple eigenvalues when k = 1: 
(a) A < 0; (b) A> 0. 


types of equilibria: stable node, unstable node, saddle point, stable focus, unstable 
focus, and center. The type of equilibrium point is completely specified by the lo- 
cation of the eigenvalues of A. Note that the global (throughout the phase plane) 
qualitative behavior of the system is determined by the type of equilibrium point. 
This is a characteristic of linear systems. When we study the qualitative behavior 
of nonlinear systems in the next section, we shall see that the type of equilibrium 
. point can only determine the qualitative behavior of the trajectories in the vicinity 
B of that point. 


Case 4. One or both eigenvalues are zero. 


When one or both eigenvalues of A are zero, the phase portrait is in some sense 
degenerate. Here, the matrix A has a nontrivial null space. Any vector in the 
null space of A is an equilibrium point for the system; that is, the system has au 


I 
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(a) (b) 


Figure 2.10: Phase portraits for (a) 4; = 0, Az < 0; (b) 41 20, 22» 0. 


equilibrium subspace, rather than an equilibrium point. The dimension of the null 
space could be one or two; if it is two, the matrix A will be the zero matrix. This 
is a trivial case where every point in the plane is an equilibrium point. When the 
dimension of the null space is one, the shape of the Jordan form of A will depend 
on the multiplicity of the zero eigenvalue. When A1 = 0 and Àz Æ 0, the matrix M 
is given by M = [v1, v2] where v, and v are the associated eigenvectors. Note that 
v spáns the null space of A. The change of variables z = M!s results in 


2, = 0, 29 = A229 


whose solution is 
zi(t) = zo —-22(t) = ze! 

The exponential term will grow or decay, depending on the sigu of Ao. Figure 2.10 
shows the phase portrait in the x;-.c2 plane. All trajectories converge to the equi- 
librium subspace when A? < 0, and diverge away from it when A > 0. 

When both eigenvalues are at the origin, the change of variables z = Mz 
results in 

A = 29, 22-0 


whose solution is 
z1(t) = zio  zagt, za (t) = 220 


The term zot will increase or decrease, depending on the sign of 259. The z;-axis is 
the equilibrium subspace. Figure 2.11 shows the phase portrait in tbe z;-2 plane; 
the dashed line is the equilibrium subspace. The phase portrait in Figure 2.11 is 
quite different from that in Figure 2.10. Trajectories starting off the equilibrium 
subspace move parallel to it. 

The study of the behavior of linear systems about the equilibrium point z = 0 is 
important because, in many cases, the local behavior of a nonlinear system near an 
equilibrium point can be deduced by linearizing the system about that point and 
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Figure 2.11: Phase portrait when Ay = A; = 0. 


studying the behavior of the resultant linear system. How conclusive the lineariza- 
tion approach is depends to a great extent on how the various qualitative phase 
portraits of a linear system persist under perturbations. We can gain insight into 
the behavior of a linear system under perturbations by examining the special case 
of linear perturbations. Suppose A has distinct eigenvalues and consider A + AA, 
where AA is a 2 x 2 real matrix whose elements have arbitrarily small magnitudes. 
- From the perturbation theory of matrices,? we know that the eigenvalues of a ma- 
trix depend continuously on its parameters. This means that, given any positive 
number e, there is a corresponding positive number 6 such that if the magnitude 
of the perturbation in each element of A is less than 6, the eigenvalues of the per- 
turbed matrix A + AA will lie in open discs of radius ¢ centered at the eigenvalues 
of A. Consequently, any eigenvalue of A that lies in the open right-half plane (pos- 
itive real part) or in the open left-half plane (negative real part) will remain in 
its respective half of the plane after arbitrarily small perturbations. On the other 
hand, eigenvalues on the imaginary axis, when perturbed, might go into either the 
right-half or the left-half of the plane, since a disc centered on the imaginary axis 
will extend in both halves no matter how small € is. Consequently, we can conclude 
that if the equilibrium point x = 0 of z = Az is a node, focus, or saddle point, 
then the equilibrium point x = 0 of Z = (A+ AA)z will be of the same type for 
sufficiently small perturbations. The situation is quite different if the equilibrium 
point is a center. Consider the perturbation of the real Jordan form in the case of 


a center 
H 1 
—-1 u 


where y is a perturbation parameter. When y is positive, the equilibrium point of 
the perturbed system is an unstable focus; when y is negative, it is a stable focus. 


2Sce [67, Chapter 7]. 
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This is true no matter how sm all p i i 
e all p is, as long as it is different from zero. Beca 
; ] us 
aaa algo vi a ae focus and unstable focus are qualitatively different 
phase portrait of a center, we see that a center ilibri i 
e equilibriun po i 
ro dips S perturbations. The node, focus, and saddle Sulis ponas 
Te said to be structurally stable because the intai i itati 
d to be. y maintain their qualitative behavi 
under infinitesimally small perturbations, whi i dudit 
3 1” While the center equilibrium oint i 
"eiii ges The distinction between the two cases is due to PAE TE 
e eigenvalues of A, with the eigenvalues on the imagi is bei 
í A, with th aginary axis being vulnerable t. 
perturbations. This brings in the definitio i 5 The 
n of a hyperbolic equilibri j 
origin x = 0 is said to be a h i ilibri VON gini: 
yperbolic equilibri i t= i 
eigenvalues with zero real part.4 RM QM M pee 
; : ] 

NS. en n has multiple nonzero real eigenvalues, infinitesimally small perturba- 
could result in a pair of complex eigenvalues. Hence, a stable (respectively, 


unstable) node would either remain a s i 
table (respectivi 
& stable (respectively, unstable) focus, "m SONDRE mode or beaji 


b 
H a ae due we end up with two real distinct eigenvalues 
(t Ibrium point of the perturbed system will b i 
H * H ia : 
a saddle point, depending on the signs of Ap and u. This is already an idu 


gives more insight into the qualitative behavi 
ior of the system. Since |À 
into t y . Since 
exponential term e2! will change with t much faster than the Bc ndi dee 
: 3, 


Chapter 11. 


When both eigenvalues of A are zeros, the effect of perturbations is more dra 


3g = 
ee (81, Chapter 16} for a rigorous and more general definition of structural stability. 
ATI is definiti fal boli ilibri n i hig} 1 : 
us definition of a yperbolic equilibrium point exten s to 1g, er-dimensional systems. It 


also carries over to equilibria of nonli 
ne dim onlinear systems by applying it to the eigenvalues of the linearized 
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(b). 


Figure 2.12: Phase portraits of a. perturbed system when A, = 0 and A; < 0: (a) 
nu «0; (b) p> 0. 


matic. Consider the four possible perturbations of the Jordan form 


feo} Leah [eah m [6] 


where y is a perturbation parameter that could be positive or negative. It can easily 
be seen that the equilibrium points in these four cases are a center, a focus, a node, 
and a saddle point, respectively. In other words, all the possible phase portraits of 
an isolated equilibrium point could result from perturbations. 


2.2 Multiple Equilibria 


The linear system < = Az has an isolated equilibrium point at x = 0 if A has no 
zero eigenvalues, that is, if det A 4 0. When det A = 0, the system has a continuum 
of equilibrium points. These are the only possible equilibria patterns that a linear 
system may have. A nonlinear system can have multiple isolated equilibrium points. 
In the following two examples, we explore the qualitative behavior of the tunnel- 
diode circuit of Section 1.2.2 and the pendulum equation of Section 1.2.1. Both 
systems exhibit multiple isolated equilibria. 


Example 2.1 The state model of a tunnel-diode circuit is given by 
& = cim) +a] 
A 1 
32 = zi cur Rz, + u] 


Assume that the circuit parameters are? u = 1.2 V, R = 1.5 kQ = 1.5 x 10° Q, 
C = 2 pF = 2 x 107 F, and L = 5 pH = 5 x 1079 H. Measuring time in 


5The numerical data are taken from [39]. 


A 
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Figure 2.13: Phase portrait of the tunnel-diode circuit of Example 2.1. 


nanoseconds and the currents z2 and h(z1) in mA, the state model is given by 


0.5[-h(z1) + z2] 
0.2(—21 — 1.522 + 1.2) 


ii 


ll 


t2 
Suppose that h(-) is given by 
h(zi) = 17.762, — 103.7921 + 229.6223 — 226.3121 + 83.7225 


By setting $j = $9 = 0 and solving for the equilibrium points, we can verify that 
there are three equilibrium points at (0.063, 0.758), (0.285,0.61), and (0.884, 0.21). 
The phase portrait of the system, generated by a computer program, is shown in 
Figure 2.13. The three equilibriuin points are denoted in the portrait by Qi, Qe, 
and Qs, respectively. Examination of the phase portrait shows that, except for 
two special trajectories, which approach Qs, all trajectories eventually approach 
either Q; or Qs. Near the equilibrium points, the trajectories take the form of a 
saddle for Qz and stable nodes for Q1 and Qa. The two special trajectories, which 
approach Qe, are the stable trajectories of the saddle. They form a curve that 
divides the plane into two halves. All trajectories originating from the left side of 
the curve will approach Qi, while all trajectories originating from the right side 
will approach Qs. This special curve is called a separatriz, because it partitions the 
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Figure 2.14: Adjustment of the load line of the tunnel-diode circuit during triggering. 


plane into two regions of different qualitative behavior. In an experimental setup, 


we shall observe one of the two steady-state operating points Qj or Qs, depending ` 


on the initial capacitor voltage and inductor current. The equilibrium point at Q» 
is never observed in. practice because the ever-present physical noise would d 
the trajectory to diverge from Q» even if it were possible to set up the exact initia 
'onditions corresponding to Q2. i 
ie patali n us 2.13 tells us the global qualitative behavior Ke 
the tunnel-diode circuit. The range of x; and x2 was chosen so that all essentia 
qualitative features are displayed. The portrait outside this range does not contain 
new litative features. i 
A The onde diode circuit with multiple equilibria is referred to as a bistable cir- 
cuit, because it has two steady-state operating points. It has been used as a ied 
puter memory, where the equilibrium point Q; is associated with the binary sta e 
“0” and the equilibrium point Qs is associated with the binary state 1. Rico s 
from Q; to Qs or vice versa is achieved by a triggering signal of sufficient amp itu e 
and duration that allows the trajectory to move to the other side of the neers 
For example, if the circuit is initially at Qi. then a positive pulse added to a 
supply voltage u will carry the trajectory to the right side of the d i 
pulse must be adequate in amplitude to raise the load line beyond the das e : PE 
in Figure 2.14 and long enough to allow the trajectory to reach the right side of the 


separatrix. . "T ] 
Another feature of this circuit can be revealed if we view it as a system with 


input u = E and output y = vg. Suppose we start with a small value of u such that | 


the only equilibrium point is Q1. After a transient period, the system settles at Qi. 
Let us now increase u gradually, allowing the circuit to settle at an equilibrium point 


ÜIn general, the state plane decomposes into a number of regions, within each of which me 
trajectories may show a different type of behavior. The curves separating these regions are cal 


separatrices. 


L Ds s 


23. MULTIPLE EQUILIBRIA 


Figure 2.15: Hysteresis characteristics of the tunnel-diode circuit. 


after each increment of u. For a range of values of u, Q; will be the only equilibrium 
point. On the input-output characteristic of the system, shown in Figure 2.15, this 
range corresponds to the segment EA. As the input is increased beyond the point 
A, the circuit will have two steady-state operating points at Qi, on the segment 
AB, and Qs, on the segment CD. Since we are increasing u gradually, the initial 
conditions will be near Q; and the circuit will settle there, Hence, the output will 
be on the segment AB. With further increase of u, we will reach a poiht where 
the circuit will have only one equilibrium point at Q3. Therefore, after a transient 
period the circuit will settle at Qs. On the input-output characteristic, it will 
appear as a jump from B to C. For higher values of u, the output will remain 
on the segment CF. Suppose now that we start decreasing u gradually. First, 
there will be only one equilibrium point Qs; that is, the output will move along 
the segment FC. Beyond a certain value of u, corresponding to the point C, the 
circuit will have two steady-state operating points at Qj and Qs, but will settle 
at Q3 because its initial conditions will be closer to it. Hence, the output will be 
on the segment CD. Eventually, as we decrease u beyond the value corresponding 
to D, the circuit will have only one equilibrium point at Q, and the characteristic 
will exhibit another jump from D to A. Thus, the input-output characteristic of 
the system features a hysteresis behavior. Notice that by drawing the input-output 
characteristic of Figure 2.15, we ignore the dynamics of the system. Such viewpoint 
will be reasonable when the input is slowly varying relative to the dynamics. of the 
system so that the transient time between different steady-state operating points - 
can be neglected.” A 


Example 2.2 Consider the following pendulum equation with friction: 


xy = T2 


TThis statement can be justified by the singülar perturbation theory presented in Chapter 11. 
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m -2 


Figure 2.16: Phase portrait of the pendulum equation of Example 2.2. 


$9 = —10sinz, — T2 


A computer-generated phase portrait is shown in Figure 2.16. The phase portrait 
is periodic in z with period 27. Consequently, all distinct features of the system's 
qualitative behavior can be captured by drawing the portrait in the vertical strip 
—T € z, € v. As we noted earlier, the equilibrium points (0,0), (27,0), (—27,0), 
etc., correspond to the downward equilibrium position (0,0). Trajectories near 
these equilibrium points have the pattern of a stable focus. On the other hand, 
the equilibrium points at (7,0), (—7,0), etc., correspond to the upward equilibrium 
position (7,0). Trajectories near these equilibrium points have the pattern of a 
saddle. The stable trajectories of the saddles at (7,0) and (—7,0) form separatrices 
which contain a region with the property that all trajectories in its interior approach 
the equilibrium point (0,0). This picture is repeated periodically. The fact that 
trajectories could approach different equilibrium points correspond to the number 
of full swings a trajectory would take before it settles at the downward equilibrium 
position. For example, the trajectories starting at points A and B have the same 
initial position, but different speeds. The trajectory starting at A oscillates with 
decaying amplitude until it settles down at equilibrium. The trajectory starting at 
B, on the other hand, has more initial kinetic energy. It makes a full swing before it 


2.3. BEHAVIOR NEAR EQUILIBRIA 51 


starts to oscillate with decaying amplitude. Once again, notice that the “unstable” 
equilibrium position (7,0) cannot be maintained in practice, because noise would 
cause trajectories to diverge away from that position. A 


2.3 Qualitative Behavior Near Equilibrium Points 


Examination of the phase portraits in Examples 2.1 and 2.2 shows that the qual- 
itative behavior in the vicinity of each equilibrium point looks just like those we 
saw in Section 2.1 for linear systems. In particular, in Figure 2.13 the trajectories 
near Qi, Q2, and Qs are similar to those associated with a stable node, saddle 
point, aud stable node, respoctively. Similarly, in Figure 2.16 the trajectories near 
(0,0) and (7,0) are similar to those associated with a stable focus and saddle point, 
respectively. In this section, we will sec that we could have seen this behavior near 
the equilibrium points without drawing the phase portrait. It will follow from the 
general property that, except for some special cases, the qualitative behavior of a 
nonlinear system near an equilibrium point can be determined via linearization with 
respect to that point. l 

Let p = (pi, pz) be an equilibrium point of the nonlinear system (2.1)-(2.2) and 
suppose that the functions fi and fz are continuously differentiable. Expanding 
the right-hand side of (2.1)-(2.2) into its Taylor series about tlie point (p1, p2), we 
obtain ' 


$i = fil(pı p2) + an(zi — m)  aiz(22 — po) + H.O.T. 


$3 = fo(pi,p2) + ai(r1 — py) + azz (22 — p2) + H.O.T. 
where 
e 9fi(z1, 22) ane Ofi (a1, x2) 
oxy ©1=Pi.22=p2 Ox2 £1 =P1,22=p2 
—— Ofz(z1,22) , jae Ofo(z1, 22) 
Oxy T; =p ,t4=p2 Ox. c z—pjT2-p2 


and H.O.T. denotes higher order terms of the expansion, that is, terms of the form 


(zi -pi)*, (22 - p2)?, (z1 ^1) x (z2 — pz), and so on. Since (pı, p2) is an equilibrium 
point, we have 


fiim. p) = fa(m,pa) = 0 
Moreover, since we are interested in the trajectories near (pi, pa), we define 
yı =z -pi and y22z2—p» 
and rewrite the state equations as 


$ = 2) = ayy) + any + H.O.T. 
Yo = d2 = any + azy: + H.O.T. 
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If we restrict attention to a sufficiently small neighborhood of the equilibrium point 
such that the higher-order terms are negligible, then we may drop these terms and 
approximate the nonlinear state equations by the linear state equations 


Ho = ayy t azy 
Yo. = aaiyi + a242 


Rewriting the equations in a vector form, we obtain 


ý = Ay 


Is | E A 3z 

A zz = = — 
8 8 Oz |. 
Bd. 0 

The matrix [Of /0z] is called the Jacobian matrix of f(z), and A is the Jacobian 

matrix evaluated at the equilibrium point p. 


where 


231 Q22 


It is reasonable to expect the trajectories of the nonlinear system in a small : 


neighborhood of an equilibrium point to be "close" to the trajectories of its lin- 
carization about that point. Indeed, it is true that? if the origin of the linearized 
state equation is a stable (respectively, unstable) node with distinct eigenvalues, a 
stable (respectively, unstable) focus, or a saddle point, then, in a small neighborhood 
of the equilibrium point, the trajectories of the nonlinear state equation will behave 
like a stable (respectively, unstable) node, a stable (respectively, unstable) focus, or 
a saddle point. Consequently, we call an equilibrium point of the nonlinear state 
equation (2.1)-(2.2) a stable (respectively, unstable) node, a stable (respectively, 
unstable) focus, or a saddle point if the linearized state equation about the equilib- 
rium point has the same behavior. The type of equilibrium points in Examples 2.1 
and 2.2 could have been determined by linearization without the need to construct 
the global phase portrait of the system. 


Example 2.3 The Jacobian matrix of the function f(r) of the tunnel-diode circuit 
in Example 2.1 is given by 


af -0.5h'(z,) 0.5 


—0.2 —0.3 


where 


h 
h'(z1) = a = 17.76 — 207.582, + 688.8621 — 905.242] + 418.621 


EThe proof of this linearization property can be found in [76]. It is valid under the assumption 
that fi(z1,72) and f2(z1,22) have continuous first partial derivatives in a neighborhood of the 
equilibrium point (pi, p2). A related, but different, linearization result will be proved in Chapter 
3 for higher-dimensional systems. (See Theorem 4.7.) 
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Evaluating the Jacobian matrix at the equilibrium points Q, = (0.063, 0.758), 
Q» = (0.285, 0.61), and Q3 = (0.884, 0.21), respectively, yields the three matrices 


—3:5908 0.5 ; : 
Aj = | -02 -03 | , Eigenvalues: — 3.57, —0.33 
182 05. ; 
Ag = | 02 0.3 | , Eigenvalues: 1.77, —0.25 
-1427 0.5 ; i 
A3 = | 02 -03 | , Eigenvalues: — 1.33, —0.4 
Thus, Q; is a stable node, Q% is a saddle point, and Q3 is a stable node. A 


Example 2.4 The Jacobian matrix of the function f(z) of the pendulum equation - 


in Example 2.2 is given by 
of _ | 0 1 | 


or -10cosz; -1 


Evaluating the Jacobian matrix at the equilibrium points (0,0) and (7,0) yields, 


respectively, the two matrices 


A 


| A P | S Eigenvalues ; — 0.5 + j3.12 


Ao = | 1 m | , Eigenvalues : — 3.7, 2.7 


Thus, the equilibrium point (0,0) is a stable focus and the equilibrium point (7,0) 


is & saddle point. A 


Note that the foregoing linearization property dealt only with cases when the 


linearized state equation has no eigenvalues on the imaginary axis, that is, when 
the origin is a hyperbolic equilibrium point of the linear system. We extend this 


definition to nonlinear systems and say that an equilibrium point is hyperbolic if 


the Jacobian matrix, evaluated at that point, has no eigenvalues on the imaginary 
axis. If the Jacobian matrix, has eigenvalues on the imaginary axis, then the qual- 
itative behavior of the nonlinear state equation near the equilibrium point could 
be quite distinct from that of the linearized state equation. This should come as 
no surprise in view of our earlier discussion on the effect of linear perturbations 
on the qualitative behavior of a linear system when the origin is not a hyperbolic 
equilibrium point. The example that follows considers a case when the origin of the 
linearized state equation is a center. 


Example 2.5 The system 


ij = -22- px, (x? + 12) 
ty z; — uza(z1 + 23) 
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has an equilibrium point at the origin. The linearized state equation at the origin 
has eigenvalues +j. Thus, the origin is a center equilibrium point for the linearized 
system. We can determine the qualitative behavior of the nonlinear system by 
representing it in the polar coordinates: 


zı =rcos@é and z3-rsinó 


which yield : 
; *--yr! and 6-1 
From these equations, it can be easily seen that the trajectories of the nonlinear 


system will resemble a stable focus when p > 0 and an unstable focus when p < 0. 
A 


The preceding example shows that the qualitative behavior describing a center 
in the linearized state equation is not preserved in the nonlinear state equation. 

The foregoing discussion excludes the case when the linearized state equation has 
a node with multiple eigenvalues. Exercise 2.5 shows a case where the linearization 
has a stable node, while the trajectories of the nonlinear state equation behave like 
a stable focus. It should be mentioned, however, that a smoother function f(x) 
will not allow this to happen. In particular, if f1(z1, 22) and fo(x1, z2) are analytic 
functions? in a neighborhood of the equilibrium point, then it is true that!? if the 
origin of the linearized state equation is a stable (respectively, unstable) node, then, 
in a small neighborhood of the equilibrium point, the trajectories of the nonlinear 
state equation will behave like a stable (respectively, unstable) node whether or not 
the eigenvalues of the linearization are distinct. 


Determining the type of equilibrium points via linearization provides useful in-. 


formation that should be used when we construct a global phase portrait of a 
second-order system, whether we do that graphically or numerically. In fact, the 
first step in constructing a phase portrait should be the calculation of all equilibrium 
points and determining the type of isolated ones via linearization, which will give 
us a clear idea about the expected portrait in the neighborhood of the equilibrium 
points. 


2:4 Limit Cydles 


“Oscillation’ is one of the most important phenomena that occur in dynamical sys- 
tems. A system oscillates when it has a nontrivial periodic solution 


a(t+T)=2(t), Vt20 


for some T > 0. The word “nontrivial” is used to exclude constant solutions corre- 
sponding to equilibrium points. A constant solution satisfies the preceding equation, 


9'That is, fı and f2 have convergent Taylor series representations. 
10Se0 [115, Theorem 3.4, page 188]. 
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Figure 2.17: A linear LC circuit for the harmonic oscillator. 


but it is not what we have in mind when we talk of oscillation or poriodic solutions. 
Unless otherwise specified, from this point on whenever we refer to a periodic solu- 
tion, we will mean a nontrivial one. The image of a periodic solution in the phase 
portrait is a closed trajectory, which is usually called a periodic orbit or a closed 
orbit. 

We have already seen an example of oscillation in Section 2.1: the second-order 
linear system with eigenvalues +48. The origin of that system is a center and the 
trajectories are closed orbits. When the system is transformed iuto its real Jordan 
form, the solution is given by 


z(t) = ro cos(Gt + 0g), z9(t) = ro sin(@t + 69) 


where 


Ti = -1 zm 
o = 4/z2(0) + 22(0), o = tan ES 
Therefore, the system has a sustained oscillation of amplitude rg. It is usually 
referred to as the harmonic oscillator. If we think of the harmonic oscillator as a 
model for the linear LC circuit of Figure 2.17, then we can see that the physical 
mechanism leading to these oscillations is a periodic exchange (without dissipation) 
of the energy stored in the capacitor's electric field with the energy stored in the 
inductor's magnetic field. There are, however, two fundainental problems with 
this linear oscillator. The first problem is one of robustness. We have seen that 
infinitesimally small right-hand side (linear or nonlinear) perturbations will destroy 
the oscilletion. That is, the linear oscillator is not structurally stable. In fact, it 
is impossible to build an LC circuit that realizes the harmonic oscillator, for the 
resistance in the electric wires alone will eventually consume whatever energy was 
initially stored in the capacitor and inductor. Even if we succeeded in building the 
linear oscillator, we would face the second problem: the amplitude of oscillation is 
dependent on the initial conditions. 

The two fundamental problems of the linear oscillator can be eliminated in 
nonlinear oscillators. It is possible to build physical nonlinear oscillators such that 


e The nonlinear oscillator is structurally stable. 


e The amplitude of oscillation (at steady state) is independent of initial condi- 
tions. 
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The uegative-resistance oscillator of Section 1.2.4 is an example of such nonlinear 
oscillators. The state equations of the svstem are given by 


ii = 19 
fg = -q —eh'(2))z2 


where the function h satisfies certain properties, stated in Section 1.2.4. The system 
has only one equilibrium point at xı = rz = 0. The Jacobian matrix at this point 
is given by 


| of 0 1 


A = — = 
Orio | -1 —eh'(0) 


Since h’(0) < 0, the origin is either an unstable node or unstable focus, depending 
on the value of eh'(0); In either case, all trajectories starting near the origin would 
diverge away from it and head toward infinity. The repelling feature of the origin is 
due to the negative resistance of the resistive element near the origin, which means 
that the resistive element is “active” and supplies energy. This point can be seen 
analytically by writing an expression for the rate of change of energy. The total 
energy stored in the capacitor and inductor at any time f is given by 


E = jov + 5 Liz 
We have seen in Section 1.2.4 that. 


ve = Ti and iL = —h(z1) = Lm 


: Thus, recalling that € = y L/C, we can rewrite the energy expression as 


E = ¿C {a} + [8h(r1) + ag]?) 
The rate of change of energy is given by 
E = C{r 2 + feh(ry) + za][eA (ay )2i + £2]) 
C (a9 + [Eh(r1) + vs] [eh (31)12 — x1 — eh’ (21)22]) 


C[ziz2 — exi h(x1) — ziza] 
= —eCah(z1) 


The preceding expression confirms that. near the origin. the trajectory gains energy 
since for small |z1] the term zj ^(:1) is negative. It also shows that there is a strip 
—a € x; € b such that the trajectory gains energy within the strip and loses energy 
outside the strip. The strip boundaries —a and b are roots of h(z1) = 0, as shown 
in Figure 2.18. As a trajectory moves in and out of the strip, there is an exchange 
of energy with the trajectory gaining energy inside Lhe strip and losing it outside. 
A stationary oscillation will occur if. along a trajectory, the net exchange of energy 
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Figure 2.18: A sketch of ^(z) (solid) and —2,h(a1) (dashed), which shows that E is 
positive for —a < z, <b. 
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Figure 2.19: Phase portraits of the Van der Pol oscillator: (a) e = 0.2; (b) € = 1.0. 


over one cycle is zero. Such a trajectory will be a closed orbit. It turns out that 
the negative-resistance oscillator has an isolated closed orbit, which is illustrated in 
the next example for the Van der Pol oscillator. 


Example 2.6 Figures 2.19(a), 2.19(b), and 2.20(a) show the phase portraits of the 
Van der Pol equation 


di = m (2.5) 
d; = -zı +e(l-—zri)z (2.6) 


for three different values of the parameter &: a small value of 0.2, a medium value 
of 1.0, and a large value of 5.0. In all three cases, the phase portraits show that 
there is a unique closed orbit that attracts all trajectories starting off the orbit. For 
€ = 0.2, the closed orbit is a smooth orbit that is close to a circle of radius 2. This 
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Figure 2.20: Phase portrait of the Van der Pol oscillator with € = 5.0: (a) in zj— 
plane; (b) in z;—z2 plane. 


is typical for small € (say, e < 0.3). For the medium value of € = 1.0, the circular 
shape of the closed orbit is distorted as shown in Figure 2.19(b). For the large value 
of € = 5.0, the closed orbit is severely distorted as shown in Figure 2.20(a). A more 
revealing phase portrait in this case can be obtained when the state variables are 
chosen as 2, = iz and z2 = vc, resulting in the state equations 


ZA r 
1 = -22 
€ 


i = —e(zı — z2 + 423) 


The phase portrait in the z;-22 plane for € = 5.0 is shown in Figure 2.20(b). The 
closed orbit is very close to the curve z1 = 22 — (1/3)23, except at the corners, where 
it becomes nearly vertical. The vertical portion of the closed orbit can be viewed as 
if the closed orbit jumps from one branch of tlie curve to the other as it reaches the 
corner, Oscillations where the jump phenomenon takes place are usually referred to 
as relaxation oscillations. This phase portrait is typical for large values of & (say, 
€ » 3.0). A 


The closed orbit we have seen in Example 2.6 is different from what we have 
seen in the harmonic oscillator. In the case of the harmonic oscillator, there is a 
. continuum of closed orbits, while in the Van der Pol example, there is only one 
isolated periodic orbit. An isolated periodic orbit is called a limit cycle. The limit 
cycle of the Van der Pol oscillator has the property that all trajectories in the 
vicinity of the limit cycle ultimately tend toward the limit cycle as t — oo. A 
limit cycle with this property is classically known as a stable limit cycle. We shall 
also encounter unstable limit cycles, which have the property that all trajectories 
starting from points arbitrarily close to the limit cycle will tend away from it as 
t — oo. (See Figure 2.21.) To see an example of an unstable limit cycle, consider 
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(s) E () 


Figure 2.21: (a) A stable limit cycle; (b) an unstable limit cycle. 


the Van der Pol equation in reverse time; that is, 


ii = —2I9 


i2 zı — e(1 — 22)z2 

The phase portrait of this system is identical to that of the Van der Pol oscillator, 

except that the arrowheads are reversed. Consequently, the limit cycle is unstable. 
The limit cycle of the Van der Pol oscillator of Example 2.6 takes special forms 

in the limiting cases when € is very small and very large. Theso special forms can 


be predicted analytically by using asymptotic methods. In Chapter.10, we will use 
the averaging method to derive the special form of the limit cycle as € — 0; while in ,- 
Chapter 11, we will use the ‘singular perturbation method to derive the special form - 


1 Materie of the limit cycle as € — oo. 


2.5 Numerical Construction of Phase Portraits 


Computer programs for numerical solution of ordinary differential equations are 
widely available. They can be effectively used to construct phase portraits for 
second-order systems. In this section, we give some hints!! that might be useful for 
beginners. 

The first step in constructing the phase portrait is to find all equilibrium points 
and determine the type of isolated ones via linearization. 

Drawing trajectories involves three tasks:!? 


e Selection of a bounding box in the state plane where trajectories are to be 


llThese hints are taken from [149, Chapter 10], which contains more instructions on how to 
generate informative phase portraits. 

12A fourth task that we left out is placing arrowheads on the trajectory. For the purpose of this 
textbook, it can be conveniently done manually. 
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drawn. The box takes the form 


Zimin $ X1 $ Timar: T2min $ t2 S Tmar 
è Selection of initial points (conditions) inside the bounding box. 


e Calculation of trajectories. 
Lot us talk first about calculating trajectories. To find the trajectory passing 


through a point zo, solve the equation 
t= f(x). x(D) = 20 


in forward time (with positive t) and in reverse time (with negative t). Solution in 
reverse timo is equivalent to solution in forward time of the equation 


&--f(r) 2(0) = To 


since the change of time variable r = —t reverses the sign of the right-hand side. 
ing away from Zo, while the 


The arrowhead on the forward trajectory is placed head 
one on the reverse trajectory is placed heading into zo. Note that solution in reverse 
time is the only way we can get & good portrait in the neighborhood of unstable 
focus, unstable node, or unstable limit cycle. Trajectories are continued until they 
get out of the bounding box. If processing time is a concern, you may want to add 
a stopping criterion when trajectories converge to an equilibrium point. 

The bounding box should be selected so that all cssential qualitative features 
are displayed. Since some of these features will not be known a priori, we may have 
to adjust the bounding box interactively. However, our initial choice should make 
use of all prior information. For example, the box should include all equilibrium 
points. Care should be exercised when a trajectory travels out of bounds, for such 
a trajectory is either unbounded or is attracted to a stable limit cycle. 

The simplest approach to select initial points is to place them uniformly on a grid 
throughout. the bounding box. However, an evenly spaced set of initial conditions 
rarely yields an evenly spaced set of trajectories. A better approach is to select the 
initial points interactively after plotting the already calculated trajectories. Since 
most computer programs have sophisticated plotting tools, this approach should be 
quite feasible. ' 

Vor a saddle point, we can use linearization to generate the stable and unstable 
trajectories. This is useful because. as we saw in Examples 2.1 and 2.2, the stable 
trajectories of a saddle define a scparatrix. Let the eigenvalues of the linearization 

be Àj > 0 > Ag and the corresponding eigenvectors be v, and vz. The stable and 
unstable trajectories of the nonlinear saddle will be tangent to the stable eigenvector 
vj and the unstable eigenvector vi, respectively, as they approach the equilibrium 
point p. Therefore, the two unstable trajectories can be generated from the initial 
points sy = p x ovi, where a is a small positive number. Similarly, the two stable 
trajectories can be generated from the initial points zo = p + ava. The major parts 
uf the unstable trajectories will be gencrated by solution in forward time, while the 
major parts of the stable ones will he generated by solution in reverse time. 
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2.6 Existence of Periodic Orbits 


Periodic orbits in the plane are special in that they divide the plane into a region 

inside the orbit and a region outside it. This makes it possible to obtain criteria 

for detecting the presence or absence of periodic orbits for second-order systems 

which have no generalizations to higher order systems. The most celebrated of 

these criteria are the Poincaré-Bendixson theorem, the Bendixson criterion, and 

the index method. te UE 2 
We consider the second-order autonomous system 


i= f(z) (2.7) 


where f(z) is continuously differentiable. Poincaré-Bendixson theorem gives a con- 
dition for the existence of periodic orbits of (2.7). We will not give the formal’ l 
statement of the theorem,!? but will give a corollary of the theorem which sum- 
marizes how the theorem is actually applied. We refer to this'corollary as the 
Poincaré-Bendixson criterion. 


Lemma 2.1 (Poincaré-Bendixson Criterion) Consider the system (2.7) and 
let AI be a closed bounded subset of the plane such. that 


eM contains no equilibrium points, or contains only one equilibrium point such 
that the Jacobian matriz [Of /Ox| at this point has eigenvalues with positive 
real parts. (Hence, the equilibrium point is unstable focus or unstable node.) 


e Every trajectory starting in M stays in M for all future time. 
Then, M contains a periodic orbit of (2.7). 


The intuition behind the criterion is that bounded trajectories in the plane will 
have to approach periodic orbits or equilibrium points as time tends to infinity. If M 
contains no equilibrium points, then it:must contain a periodic orbit..If M. contains 
only one equilibrium point that satisfies the stated conditions, then in the vicinity ` 
of that point all trajectories will be moving away from it. Therefore, we can choose 
a simple closed curve! around the equilibrium point such that the vector field on 
the curve points outward.!5 By redefining the set M to exclude the region enclosed 
by this curve (see Figure 2.22), we end up with a set that is free of equilibrium 
points, and all trajectories are trapped in it. 

As a tool for investigating whether trajectories are trapped inside a set Af 
consider a simple closed curve defined by the equation’ V(x). “6 whére?V (£) is 


continuously differentiable. The vector field: f(x)*at*a:point z.on the curve points: 


13For the statement and i i s : | 
proof of the Poincaré-B 
the second poeni and pio ré-Bendixson theorem, see, for example, [135] or 
SA = in qam Eni ae the plane into a bounded region inside the curve and an un- 
region outside it (examples are circles, elli 
15See Exercise 4.33.. taal M 
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The preceding example emphasizes the fact that the Poincaré-Bendixson criterion 
assures the existence of a periodic orbit, but not its uniqueness. From our earlier 
study of the harmonic oscillator, we know that it has a continuum of periodic orbits 
in M. 


Example 2.8 The system 


S 


å = cric -2,(2} +23) 
i2 = -2z,-4 29 — 22(2? + 23) 


has a unique equilibrium point at the origin, and the Jacobian matrix 


of 1~ 32? — 23 1 — 22,22 BUE TERES! 
az |, —2 — 2112 1-a}-303 jo |72 1 


has eigenvalues 1 + j/2. Let M = {V (z) € c}, where V(x) = z2 + z2 and c > 0. 
It is clear that M is closed, bounded, and contains only one equilibrium point at 
which the Jacobian matrix has eigenvalues with positive real parts. On the surface 
V(z) = c, we have 


Figure 2.22: Redefinition of the set M to exclude the vicinity of an unstable focus or 
node. 


inward if the: inner product of f(z) ‘and the gradient vector vv (z) is negative; that. 
ig” ES UeE DEOGMCS d l M 


B ^ + 55; = 2Qxy[ey + ni(i) + 2z2[-22i + 12 — zó(37 + z2)] 


LV» WA 2 7) We) 2 Moines Morne) «o 


Il 


2(z2 + 22) — 2(2? + 22)? — 21122 
2(zj + 23) — 221 + 23)? + (zì + 22) 
3c — 2c 


The vector field f(x) points outward if f(z)- VV(x) > 0, and it is tangent to 
the curve if f(x): VV(z) = 0. Trajectories can leave a set only if the vector 
field points outward at some point on its boundary. Therefore, for a set of the 
form M = (V(z) < c), for some c > 0, trajectories are trapped inside Af if 


IA 


where we used the fact that |2ziz9|] € z? +23. By choosing c > 1.5, we can 


P f(z): VV(z) € 0-on the boundary V(z) = c. For an annular region of the forth ensure that all trajectories are trapped inside M. Hence, by the Poincaré-Bendixson 
i M = {W(z) 2.« and V(x) € c2}, for some ei > 0 and cz > 0, trajectories are criterion. we conclude that there is a periodic orbit in M. A 
j trapped inside M if f(x): VV(x) € 0 on V(x) = cz and f(z) - VW(x) > 0 on ] : : . : 
C W(x) = e. Example 2.9 The negative-resistance oscillator of Section 1.2.4 is modeled by tlie 
f We illustrate the application of the Poincaré-Bendixsou criterion in the next second-order differential equation 
i two examples, while the third example is a nontrivial application to the negativc- H+ eh(v)ü v -0 


resistance oscillator of Section 1.2.4. 
where & is a positive constant and h satisfies the conditions 


h(0)=0, (0-0, lim h(v)- oo, and lim h(v) = —oo 


To simplity the analysis, we impose the additional requirements 


h(v)z -h(-v) h(v) <Ofor0<vu<a, and h(v)>0forv>a 


an annular region M = = z? +23 and " 
22.01» 0. The set. Mi is closed, bounded, and free of equilibrium points, sincé..= « . $- 

the only equilibrium. point.is at the origin (0,0). Trajectories are trapped inside M . 
Since f(z) - VV(z) = 0 everywhere. Hence, by the Poincaré-Bendixson criterion, 


we conclude that there is a periodic orbit in M. A... ] 


These additional requirements are satisfied by the typical function of Figure 1.6(b), 
as well as by the function h(v) = —v + (1/3)v? of the Van der Pol oscillator. 
Choose the state variables as 


zy=u and z2-0-eh(v) |a 
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to obtain the state model 


M 


di T2 — eh(zi) (2.8) 


ET = -ti 


which has a unique equilibrium point at the origin. We start our analysis by show- 
ing that every nonequilibrium solution rotates around the equilibrium point in the 
clockwise direction. To this end, we divide the state plane into four regions, which 
are determined by the intersection of the two curves 


£9—6&h(ri)20 and 2x, =0 


as shown in Figure 2.23, The figure also shows the general direction of the vector 
field f(a) of (2.8) in the four regions as well as on the boundaries between them. 
It is not difficult to see that a solution starting at point A = (0,p) on the upper 
half of the z2-axis describes an orbit with an arc of the general nature shown in 
Figure 2.24. The point E where the arc intersects the lower half of the z2-axis 


depends on the starting point A. Let us denote E by (0, —o(p)). We will show that 


if p is chosen large enough, then a(p) « p. Consider the function 
V(z) = 3(2} + 23) 
To show that a(p) < p, it is enough to show that V(E) — V(A) < 0, since 
V(E) -V(A) = 3[a°(p) - p°] = &(p) 
The derivative of V(x) is given by 
V(x) = zidi + za$$ = T122 — ex, h(x) — 2122 = —€2yh(21) 


Thus, V is positive for z;.« aand negative for z; > a. Now, 
ip) =V(E)- VIA) = f Viste) dt 
AE 


where the right-hand side integral is taken along the arc from A to E. If p is small, 
the whole arc will lie inside the strip 0 < x, < a. Then, ó(p) will be positive. As 
p increases, a piece of the arc will lie outside the strip, that is, the piece BCD in 
Figure 2.24. In this case, we evaluate the integral in different ways depending on 
whether the arc is inside or outside the strip 0 < zı < a. We divide the integral 
into three parts ; 


5(p) = éi(p) + ó»(p) + 63(p) 


where 


oe I Vea, &l)= ALO) dt, &(p)- [A Welt) a 
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Consider first the term 


dt 


61(p) = -f ezih(z1) dt = -f ezih(zi) qz dzi 
AB AB Ti 


Substituting for dz /dt from (2.8), we obtain 


1 
61 (p) = - [heu dzi 


where, along the arc AB, z» is a given function of 2}. Clearly, ó; (p) is positive. Note 
that as p increases, £2 — &h(z1) increases for the arc AB. Hence, 6,(p) decreases 
as p — oo. Similarly, it can be shown that the third term 43(p) is positive and 
decreases as p — oo. Consider now the second term 


tals) = - J mhi) diu f enhn gr dn 
BCD BCD 72 


Substituting for dr2/dt from (2.8), we obtain 


ugs f eh(z;) dz 
“e BCD 
where along the arc BCD, 2 is a given function of x2. The integral on the right- 
hand side is negative since h(z,) > 0 and dz2 < 0. As p increases, the arc ABCDE 
moves to the right and the domain of integration for ô2(p) increases. It follows that 
ó;(p) decreases as p increases and evidently limp—oo ó2(p) = —oo. In summary, we 
have shown that 


e ó(p) > 0, if p <r, for some r > 0. 
e ó(p) decreases monotonically to —co as p — co, p 2 r. 


A sketch of the function ó(p) is shown in Figure 2.25. It is now clear that by 
choosing p large enough, we can ensure that ó(p) is negative; hence, a(p) < p. 
Observe that, due to symmetry induced by the fact that h(-) is an odd function, 
if (z(t), z2(£)) is a solution of (2.8), then so is (—2z1(t), —x2(t)). Therefore, if we 
know that a path ABCDE exists as in Figure 2.24, then the reflection of that path 
through the origin is another path. Consider A = (0,p) and E = (0,—a(p)), where 
a(p) « p. Form a closed curve of the arc ABCDE, its reflection through the origin 
and segments on the x-axis connecting these arcs, to form a closed curve. (See 
Figure 2.26). Let M be the region enclosed by this closed curve. Every trajectory 
starting in M at t = 0 will remain inside for all t > 0. This is a consequence 
of the directions of the vector fields on the z-axis segments and the fact that 
trajectories do not intersect each other due to uniqueness of solutions. Now M is 
closed, bounded, and has a unique equilibrium point at the origin. The Jacobian 
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Figure 2.23: Vector field diagram for Figure 2.24: The orbit ABCDE of 


Example 2.9. Example 2.9. 
matrix at the origin 
8f 0 i 
Az Oz = 
ML -i -eh'(0) 


has eigenvalues with positive real parts since h'(0) < 0. Thus, by the Poincaré - 
Bendixson criterion, we conclude that there is a closed orbit in M. 

Using the same analysis, we can go beyond tlie Poincaré-Bendixson criterion and 
show that this closed orbit is unique. Notice that, due to the symmetry property 
alluded to earlier, the system can have a closed orbit if and only if a(p) = p. From 
Figure 2.25, it is clear that there is only one value of p for which the condition is 
satisfied. Hence, there is only one closed orbit. Furthermore, we cau show that 
every nonequilibrium solution spirals toward the unique closed orbit. To argue this 
point, let pọ > 0 be the unique value of p for which a(p) = p. Consider a point 


(0, p) intersects the lower half of the z-axis at a point (0, —a(p)), where a(p) < p. 
Due to symmetry, the trajectory through (0, —a(p)) will meet the upper half of the 
x-axis at a point (0,c(p)), where po < o(p) < p. The upper bound follows from 
the symmetry property, while the lower bound holds since for e (p) to be less than 
po, the trajectory must intersect the closed orbit. The map p — o(p) is continuous 
due to continuous depeudence of the solution on the initial states.!9 Starting again 
at the point (0, c(p)), the trajectory comes back to the upper half of the z-axis at 
(0,0? (p)), where po < c?(p) < o(p). By induction, we generate a sequence c" (p). 
which satisfies 
po €&o"*l(p) < o"(p), n=1,2,... 


16 This fact is shown in Theorem 3.4. 


(0,p) on the z2-axis with p > pp. As we argued earlier, the trajectory through . 
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Figure 2.25: A sketch of the function Figure 2.26: The closed curve formed 
ó(p) of Example 2.9. in Example 2.9. 


The sequence g” (p) has a limit p; > po. Note that, by continuity of o(-), the limit 
.pi satisfies 
o(pi) -pı = lim e(c"(p)-n7mn-mn-90 


By uniqueness of the closed orbit, it must be that pı = po. ‘This shows that the 
trajectory of p spirals toward the unique closed orbit as t — oo. The same thing is 
true for p < po. A 
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The next result, known as the Bendirson criterion, can be used to rule out. the 
existence of periodic orbits in some cases. 


-— 
-— 


Lemma 2.2 (Bendixson Criterion) If, on a simply connected region!" D of the 
plane, the cxpression ð fi /O0xi + Of2/Oxr2 is not identically zero and does not change 
sign, then system (2.7) has no periodic orbits lying entirely in D. o 


Proof: On any orbit of (2.7), we have dza/dz, = f2/ fi. Therefore, on any closed 
orbit y, we have 
[ love) dz — fi(zi, 22) dz; =0 
i 


This implies, by Green's theorem, that 


Oh . fe : 
[ [GE 25) dz, dx = 0 


17A region D is simply connected if, fór every simple closed curve C in D, the inner region of 
C is a also a subset of D. The interior of any circle is simply connected, but the annular region 
0<c& < z? + z2 € c2 is not simply connected. Intuitively speaking, simple connectedness is 
equivalent to the absence of "holes." 
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where S is the interior of y. If Of;/Or1 + Ofe/Ox2 > 0 (or < 0) on D, then we 
cannot find a region S C D such that the last equality holds. Hence, there can be 
no closed orbits entirely in D. n 


Example 2.10 Consider the system 


£i = fií(znm)) = om 
falzi, T2) = azı + brz — z1z4 — x 


£2 


and let D be the whole plane. We have 


Of, afa 2 
DA 442 eh EA 
Ox, * Oz zi 
Hence, there can be no periodic orbits if b < 0. A 


We conclude this section with a useful result that relates the existence of periodic 
orbits and equilibrium points. The result uses the (Poincaré) index of an equilibrium 
point. Given the second-order system (2.7), let C be a simple closed curve not 
passing through any equilibrium point of (2.7). Consider the orientation of the 
vector field f(x) at a point p € C. Letting p traverse C' in the counterclockwise 
direction, the vector f(x) rotates continuously and, upon returning to the original 
position, must have rotated an angle 27k for some integer k, where the angle is 
measured counterclockwise. The integer k is called the index of the closed curve 
C. If C is chosen to encircle a single isolated equilibrium point z, then & is called 
the index of Z. It is left to the reader (Exercise 2.25) to verify the next lemma by 
examining the vector fields. 


Lemma 2.3 

(a) The indez of a node, a focs, or a center is +1. 

(b) The indez of a (hyperbolic) saddle is —1. 

(c) The indez of a closed orbit is +1. 

(d) The index of a closed curve not encircling any equilibrium points is 0. 


(e) The indez of a closed curve is equal to the sum of the indices of the equilibrium 
points within it. . o 


As a corollary to this lemma, we have the following: 


Corollary 2.1 Inside any periodic orbit y, there must be at least one equilibrium 
point. Suppose the equilibrium points inside y are hyperbolic, then if N is the number 


of nodes and foci and S is the number of saddles, it must be that N-S=1. © 
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Recall that an equilibrium point is hyperbolic if the Jacobian at that point has no 
eigenvalues on the imaginary axis. If the equilibrium point is not hyperbolic, then 
its index may differ from +1. (See Exercise 2.26.) 

The index method is usually useful in ruling out the existence of periodic orbits 


in certain regions of the plane. 
Example 2.11 The system 


ti = -T+ 229 
T1 + T2 — 22,29 


12 


has two equilibrium points at (0,0) and (1,1). The Jacobian matrices at these 


points are 
E -[3 Jr H | 0 d 
Az | (oo) 11’ Az} (1.1) -1 -1 


Hence, (0,0) is a saddle, while (1,1) is a stable focus. The only combination of 
equilibrium points that can be encircled by a periodic orbit is a single focus. Other 
possibilities of periodic orbits, like a periodic orbit encircling both equilibria, are 
ruled out. A 


2.7 : Bifurcation 


The qualitative behavior of a second-order system is determined by the pattern of 
its equilibrium points and periodic orbits, as well as by their stability properties. 


, One issue of practical, importance is whether the system maintains its qualitative 


behavior under infinitesimally small perturbations. When it does so, the system is 
said to be structurally stable. In this section, we are interested in the complement of 
structural stability. In particular, we are interested in perturbations that will change 
the equilibrium points or periodic orbits of the system or change their stability 
properties. Consider, for example, the system 


D 2 
Zi = p-ti 
b = =T? 


which depends on a parameter u. For > 0, the system has two equilibrium points 
at (Vm, 0) and (— ym, 0). Linearization at (,/7/,0) results in the Jacobian matrix 


-2/n 0 
0 -1 
which shows that (,/#, 0) is a stable node, while linearization at (—,/7, 0) yields the 


Jacobian matrix 
2/u 0 
0 -1 


Figure 2.27: Phase portrait of the saddle-node bifurcation example for u > 0 (left), 
u =0 (center), and u < 0 (right). 


which shows that (—,/u,0) is a saddle. As p decreases, the saddle and node ap- 
proach each other, collide at u = 0, and disappear for » < 0. As u crosses zero, we 
witness a dramatic change in the phase portrait of the system. Figure 2.27 shows 
the phase portrait for positive, zero, and negative values of u. While for positive 
u, no matter how small it is, all trajectories in {z} > — yF} reach steady state at 
the stable node, for negative pz all.trajectories eventually escape to infinity. Such a 
change in the qualitative behavior of the system is called bifurcation. More gener- 
ally, bifurcation is a change in the equilibrium points or periodic orbits, or in their 
stability properties, as a parameter is varied. The parameter is called a bifurcation 
parameter, and the values at which changes occur are called bifurcation points. In 
the foregoing example, the bifurcation parameter is x, and the bifurcation point is 
p=0 - 

The bifurcation we saw in the previous example can be represented by the bi- 
furcation diagram shown in Figure 2.28(a). The diagram sketches a measure of the 
amplitude (or norm) of the equilibrium points versus the bifurcation parameter. 
The stable node is represented by a solid line, and the saddle by a dashed line. 
More generally, the ordinate of a bifurcation diagram is a measure of the amplitude 
of equilibrium points or periodic orbits, with solid lines representing stable nodes, 
stable foci, and stable limit cycles and dashed lines representing unstable nodes, 
unstable foci, saddles, and unstable limit cycles. The bifurcation represented in 
Figure 2.28(a) is called saddle-node bifurcation because it results from the collision 
of a saddle and a node. Note that the Jacobian matrix has a zero eigenvalue at 
. the bifurcation point. This feature is common to the bifurcations shown in Fig- 
ures 2.28(a) through (d), which are all examples of the so called zero-eigenvalue bi- 
furcation. Figure 2.28(b) shows a transcritical bifurcation, where equilibrium poiuts 
persist through the bifurcation, but their stability properties change. For example, 
the system 


r 2 
Zi = pry —2y 


i9 = —49 
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(a) Saddle-node bifurcation 


(c) Supercritical pitchfork bifurcation 


(e) Supercritical Hopf bifurcation (f) Subertitical Hopf bifurcation 


Figure 2.28: Bifurcation diagrams. 


has two equilibrium points at (0,0) and (,0). The Jacobian at (0,0) is 


[e 4| 


which shows that (0,0) is a stable node for u < 0 and a saddle for p > 0. On the 
other hand, the Jacobian at (2,0) is 


—p 0 
[ei] 

which shows that (j,0) is a saddle for x < 0 and a stable node for u > 0. So, while 
the equilibrium points persist through the bifurcation point p = 0, (0,0) changes 
from a stable node to a saddle and (4, 0) changes from a saddle to a stable node. 

Before we proceed to deséribe the other bifurcations in Figure 2.28, let us note 
an important difference between the foregoing two examples. In the latter example, 
crossing the bifurcation point causes the equilibrium point at the origin to change 
from a stable node to a saddle, but at the same time it creates a stable node at 
(u,0), which for small values of p will be close to the origin. This could mean 
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that the impact of bifurcation on the performance of the system is not dramatic. 
Suppose, for example, that the nominal system has a negative value of u so that 
the origin is a stable node. By sketching the phase portrait, it can be seen that 
all trajectories in the set {x} > u} approach the origin as time tends to infinity. 
Suppose the nominal value of » has a small magnitude so that a small perturbation 
can cause pz to become positive. Then, the origin will be a saddle and there will be a 
stable node at (1,0). A sketch of the phase portrait would show that all trajectories 
in the set {zı > 0) approach the stable node (1,0) as time tends to infinity. For 
small values of p, the steady-state operating point of the system will be close to 
the origin. So, while the perturbed system does not have the desired steady-state 
behavior, it comes close to it. The situation is quite different in the saddle-node 
bifurcation example. Suppose the nominal system has a positive value of p so that 
all trajectories in the set (zi > — yF} approach the stable node (,\/fi,0) as time 
tends to infinity. If the nominal value of p is small and a small perturbation causes 
p to become negative, the stable node disappears all together and trajectories will 
have to move away from the desired steady-state operating point, even diverge to 
infinity in this case. Because of the difference in their impact on the steady-state 
behavior, the bifurcation in the transcritical bifurcation example is said to be safe 
or soft, while that in the saddle-node bifurcation example is said to be dangerous 
or hard. 

The classification of bifurcation into safe versus dangerous cases arises also wlien 
we examine the bifurcation diagrams of Figures 2.28(c) and (d), which represent 
supercritical pitchfork and subcritical pitchfork bifurcations, respectively. The first 
of the two cases is exemplified by the system ‘ 

ii = pry~- zi 
£2 = -T 


For à < 0, there is a unique equilibrium point at the origin. By calculating the 
Jacobian, we can see that the origin is a stable node. For p > 0, there are three 
equilibrium points at (0,0). (,//5,0), and (—/u,0). Jacobian calculations show 
that (0,0) is a saddle and the other two equilibria are stable nodes. Thus, as p 
crosses the bifurcation point » = 0, the stable node at the origin bifurcates into 
a saddle and gives birth to two stable nodes at (Xyp,0). The amplitude of the 
newly created stable nodes grows with u; hence, it is small for small p. Subcritical 
pitchfork bifurcation is exemplified by the system 


LET EE 
ig = -r2 
For u < 0, there are three equilibrium points: a stable node at (0,0) and two saddles 


at (£/—y, 0). For p > 0, there is a unique equilibrium point at (0,0), which is a 
saddle. Thus, as yz crosses the bifurcation point x = 0, the stable node at the origin 


collides with the saddles at (+,/—y,0) and bifurcates into a saddle. Comparing 
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the supercritical and suberitical pitchfork bifurcations, we can easily see that the 
supercritical bifurcation is safe, while the subcritical one is dangerous. In particular, 
if the system has a nominal operating point at the stable node (0,0) for u < 0, 
then supercritical pitchfork bifurcation ensures close steady-state operation when 
L is perturbed to a small positive value, while in subcritical pitchfork bifurcation 
trajectories move away from the nominal operating point. 

In the simplified examples we used to discuss zero-eigenvalue bifurcations, we 
noticed that in dangerous cases trajectories diverge to infinity. In more complicated 
examples, the system may have other equilibrium points or periodic orbits that are 
not affected by the bifurcation under consideration. Trajectories moving away from 
the bifurcating equilibrium point could be attracted by another equilibrium point 
or period orbit rather than diverge to infinity. This situation is illustrated by the 
next example. 


Example 2.12 Consider the tunnel-diode circuit of Section 1.2.2: 


7 1. 

&à = e[-hn)- 29] 

; 1 

$2 = I [72:1 - Rz; + ul 


The diodé's v-i characteristic A(-) is sketched in Figure 1.2 and h is a constant 
input. Let us study bifurcation as y is varied. The equilibrium points of the system 
are the intersections of the curve z2 = h(z;) with the load line zz = (u — z1)/R. 
From Figure 2.29(a) and Examples 2.1 and 2.3, we know that for H < A, there is a 
stable node on the left branch; for A < u < B, there are three equilibrium points, a 
saddle on the middle branch and two stable nodes on the other two branches; and 
for » > B, there is a stable node on the right branch. The bifurcation diagram 
is shown in Figure 2.29(b). There are two saddle-node bifurcations at H= A and 
A = B. Notice that when a stable node disappears upon collision with a saddle, 
trajectories that move away are attracted by the other stable node which is not 
affected by the bifurcation. A 


When a stable node loses stability at a bifurcation point, an eigenvalue of the 
Jacobian passes through zero. What about a stable focus losing stability? In this 
case, a pair of conjugate complex eigenvalues could pass through the imaginary 
axis. Figures 2.28(e) and (f) are examples of this situation, where Figures 2.28(e) 
is called supercritical Hopf bifurcation and Figures 2.28(f).is.called subcritical Hopf 
bifurcation.'® The supercritical Hopf bifurcation is exemplified. by- the system 


ii = z(u-zi—:2)-z, 
tz = rz(u-zi-2j)t mi 


re ees 
18The names Andronov-Hopf bifurcation and Poincaré-A ndronov-Hopf bifurcation are also used 
to acknowledge the earlier contributions of Poincaré and Andronov. 
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Figure 2.29: Example 2.12: (a) determining equilibrium points; (b) bifurcation diagram. 


which is represented in the polar coordinates 
zı =rcosð and z2=rsin@ 


by : 
tepr-r? and §=1 


The system has a unique equilibrium point at the origin and the phase portraits for 


opposite signs of u are shown in Figure 2.30. ‘For pi < 0, the origin is a stable focus. 


“and-all trajectories are attracted to it, while for » » 0, the origin is an unstable 

focus; but there is.a stable limit cycle that attracts all trajectories, except tlic zero 

d solution.; ‘The limit cycle is r = yp, which shows that the amplitude of oscillation 
grows "with p and is small for small values of p. This is a safe bifurcation because 
when the stable focus disappears due to small perturbation, the system will have a 
steady-state oscillation with a small amplitude. To see how the eigenvalues behave 
during bifurcation, notice that the Jacobian at the origin 


B -1 
1 p 
has eigenvalues +j, which cross the imaginary axis from left to right as increases 
from negative to positive values. 
The subcritical Hopf bifurcation is exemplified by the system 
zı [u + (1 22) — (2f + 227] - 22 
22 [e + (of + 23) - (1 + 235] +01 


ii 


$2 
which is represented in polar coordinates by 


t=ur +r -rð and 6=1 
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' Figure 2. 30:. Phase portrait: of the supercritical Hope bifurcation example for u < 0 


(left) and y > 0 (right). 


There is a unique equilibrium point at the origin, which is a stable focus for p < 0 
and unstable focus for u > 0. From the equation 

O=pt+r?—r4 
we can determine the limit cycles of the system. For 4 < 0, there are two limit 
cycles at r? = (1 + /144y)/2. By sketching * = r(u + r? — r*) as a function of 
r (see Figure 2.31), it can be seen that the limit cycle at r? = (1+ VIF 4p)/2 is 
stable, while the limit cycle at r? = (1 — yT + 4j)/2 is unstable. For small |x|, the 
unstable limit cycle can be approximated by r? = —p. For p > 0, there is only one 
stable limit cycle at r? = (1 + /I+4j)/2. Thus, as p increases from negative to 
positive values, the stable focus at tlic origin merges with the unstable limit cycle 
and bifurcates into au unstable focus. as represented by the bifurcation diagram of 
Figures 2.28(f). Notice that the stable limit cycle is not shown in the bifurcation 
diagram because varying 4 only varies its amplitude. The subcritical Hopf bifur- 
cation is dangerous because small perturbation of & nominal stable focus at the 
origin could force trajectories to move away from the origin. Those trajectories are 
attracted by the stable limit cycle. 

All the bifurcations represented in Figure 2.28 occur in the vicinity of an equi- 
librium point. Therefore, they are called local bifurcations. There are also global 
bifurcations, which involve large regions of the state plane and cannot be described 
in the vicinity of any equilibrium point. We give only one example of global bifur- 
cations.? Consider the system 


ii = I2 
prg+ 21 — x? + ZZ 


12 


19See [187] for other examples. 
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Figure 2.31: A sketch of ur +73 — r5 for p < 0 (left) and u > 0 (right). 


There are two equilibrium points at (0,0) and (1,0). By linearization, we can sce 
that (0,0) is always a saddle, while (1,0) is an unstable focus for —1 < yp < 1. 
Let us limit our analysis to the range —1 < u < 1. Figure 2.32 shows the phase 
portrait for four different values of p. The phase portraits for y = —0.95 and —0.88 
are typical for p < He + —0.8645, while that for p= —0.8 is typical for p > pe. 
For 4 < He, there is a stable limit cycle that encircles the unstable focus. As u 
increases towards He, the limit cycle swells and finally touches the saddle at 1 = jte, 
creating a trajectory that starts and ends at the saddle; such trajectory is called 
homoclinic orbit. For p > pe, the limit cycle disappears. Note that this bifurcation 
‘occurs without any changes to the equilibrium points at (0,0) and (1,0). This type 
of global bifurcation is called saddle-connection or homoclinic bifurcation. 


2.8 Exercises ^. Figure 2.32: Saddle-connection bifurcation. 


2.1 For each of the following systems, find all equilibrium points and determine 
the type of each isolated equilibrium: 2.2 For each of the following sy ili 
. E systems, find all equilibrium poi i 
the type of each isolated equilibrium: E ICE 


(1) $i = —2 +203 +20, dg = —21—29 

(2) # =z —: dp = 234 22+ mim. - x] (1) a) = m, fy = -ntdsi-zn 

(3) ii = [i-z -—2A(x)) x, £9 = [2—A(z)] x2 (2) $i, = 221—125, O i = Qa? — ay 

HL undc © d$ = -a+ a(l- a + Ori) 9) A4 = a fp = -z2- (n2) 

(5) A4 = (m-z1-zb-313) dz = (ti+za)(1- 2} - 23) , In the third system, p(y) = y*+0.5y if |y] < 1 and p(y) = 2y — 0.5 sgn(y) if ly| > 1. 
(6) Ey es rae t2 = 21-23 2.3 For each of the systems in Exercise 2.1, d the phase portrait and 


discuss the qualitative behavior of tl 
In the third system, h(x) = r2/(1+2}). TOP 
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Figure 2.33: Phase portraits of Exercise 2.4. 


2.4 The phase portraits of the following four systems are shown in Figure 2.33. 


(1). di = 22, $9 = 2 —2tan7}(z1 +29) 

(2) di = 222, —2122, do = 22? -r2 

(3) di = 22, tg = -t +22(1 — 3r? — 223) 
. (4) # = -(n-z)-th(z) iz = —(t2— 23) + A(z) 


In the fourth system, h(z) = 1 — zı — z2. Mark the arrowheads and discuss the 
qualitative behavior of each system. 


2.5 The system 
X2 A Ti 


ii = -11 - > 
ln NE nk; 


has an equilibrium point. at the origin. 
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(a) Linearize the system about the origin and show that the origin is a stable node 
of the linear system. 


(b) Find the phase portrait of the nonlinear system near the origin and show that 
the portrait resembles a stable focus. 
Hint: Transform the equations into polar coordinates. 


(c) Explain the discrepancy between the results of parts (a) aud (b). 
2.6 Consider the system 
i; = -2, +0r9— bzirg + z? 
t2 = ~(a+b)zı + bz] — zi22 
where a > 0 and b <0. 
(a) Find all equilibrium points of the system. 


(b) Determine the type of each isolated equilibrium point, for all values of a > 0 
and b z 0. 


(c) For each of the following cases, construct the phase portrait and discuss the 
qualitative behavior of the system: 


2.7 Consider the negative resistance oscillator of Section 1.2.4 with 


hlu) = -v +03 — lo T div 


P 


and € = 1. Construct the phase portrait in the z-coordinates and discuss the 
qualitative behavior of system. 


2.8 Consider the system 
i1 = 22, £2 = -r,+ $T -1 
(a) Find the equilibrium points and determine the type of each isolated one. 
(b) Without using a computer program, atdi the phase portrait of the system. 


2.9 For cruise control, the longitudinal motion of a vehicle on a flat road can 
be modeled, with the use of Newton's second law, by the first-order differential 


equation 
mi = u — Ke sgu(v) — Kyu - Kav? 
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where m is the vehicle’s mass, v is its speed, u is the tractive force generated by the 
engine, K, sgn(v) is the coulomb friction force, K sv is the viscous friction force, and 
Kav? is the aerodynamic drag. The coefficients Ke, Ky and Ka are nonnegative. 
When a PI controller is used, u = K,ø + K (va — v), where vg is the desired speed, 
c is the state of the integrator 6 = vg — v, and K, and K, are positive constants. 
We are only interested in the region v 7 0. 


(a) Using zı = ø and zz = v as the state variables, find the state model of the 
system. 


(b) Let v, be a positive constant. Find all equilibrium points and determine the 
type of each point. : 


(c) Construct the phase portrait and discuss the qualitative behavior of the sys- 
tem, for the following numerical data: m = 1500 kg, Ke = 110 N, Ky = 
2.5 N/m/sec, Ka = 1 N/m?/sec?, K, = 15, K, = 500, and vg = 30 m/sec. 


(d) Repeat part (c) when Ky is increased to 150. Compare with the behavior in 
part (c). 


(e) Repeat part (c) when saturation is used to limit u to the range 0 € u X 1800 N. 
Compare with the behavior in part (c). 


2.10 Consider the tunnel-diode circuit of Section 1.2.2 with the numerical data 
used in Example 2.1, except for R and E, which are taken as E = 0.2V and 
R - 0.2k0. ; 


(a) Find all equilibrium points and determine the type of each point. 


(b) Construct the phase portrait and discuss the qualitative behavior of the circuit. : 
\ 


\ 


2.11 Repeat the previous problem'with E = 0.4V and R = 0.2k0. 


2.12 Consider the Hopfield neural network model of Section 1.2.4 with n = 2, 
Vy = 1, and T5; = Tig = 1. For i = 1,2, take J; = 0, C; = 1, p; = 1, Ti; = 0, and 
gilu) = (2/m) tan-! (Xru/2). 


(a) Find all equilibrium points and determine the type of each point. 


(b) For A = 5, construct the phase portrait and discuss the qualitative behavior of 
the system. l 


2.13 An equivalent circuit of the Wien-Bridge oscillator is shown in Figure 2.34 
[40], where g(v2) is a nonlinear voltage-controlled voltage source. 
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Figure 2.34: Exercise 2.13. 


(a) With zı = = i i 
) d 1 = vı and z2 = v» as state variables, show that the state model is given 


1 


i = GR, [-2i +r- g(z2)] 
d = — MCN ee +t ~ ( )] 1 
CoR cU E 


(b) Let Ci = Cy = Ry = R = 1 and g(v) = 3.234v — 2.195v? + 0.666v5. Construct | 
the phase portrait and discuss the qualitative behavior of the system. 


2.14 Consider the mass-spring system with Coulomb friction 
Ë + ky + cj + nly, ý) =0 
where 7 is defined in Section 1.2.3. Use pi ise li 
is d 2.3, piecewise linear analysis to sketch th 
phase portrait (without i i itati i : 
y (without numerical data) and discuss the qualitative behavior of the 
2.15 Consider the system 
2) = £9, t2=u 

where the control input u can take the values +1. 
(a) Sketch the phase portrait when u = 1. 
(b) Sketch the phase portrait when u = -1. 


(c) By superimposing the two i 
s the two phase portraits, develop a s itchi 
control between +1 so that an ; dates bcr. e 


"uu y point in the stat 
origin in finite time. ate plane can be moved to the 
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2.16 A prey-predatory system may be modeled by [202] 
$j,-z,(l—-21—a22) £2 = bzo(zi — 22) 


where x; and zz are dimensionless variables proportional to the prey and predator 
populations, respectively, and a and 5 are positive constants. 


(a) Find all equilibrium points and determine the type of each point. 


(b) Construct the phase portrait in the first quadrant (x, > 0, z2 > 0) when a = 1. 
b = 0.5 and discuss the qualitative behavior of the system. 


2.17 For each of the following systems, use the Poincaré-Bendixson's criterion to 
Show that the system has a periodic orbit: 


(1) ty = ea-y'-») 

(2) $i = 2, $93 = -x,+29(2 — 32? — 222) 
(3) $i = £2, tg = -T+T — 2(zi + 222)23. 
(4) $i = tı +a- xıh(z), fo = -2r +t- E 


In the fourth system, h(z) = max(|zi|, |z2]). 
2.18 (Conservative Systems) Consider the second-order system 
d1=22, #2 -g(n) 


where g is continuously differentiable and zg(z) > 0 for z € (—a,a). Consider the 
energy function i 


zy 
V(z) = $23 +f g(z) dz 
0 
(a) Show that V(z) remains constant during the motion of the system. 
(b) Show that, for sufficiently small ||z(0)||, every solution is periodic. 


(c) Suppose that zg(z) > 0 for z € (—00, 00) and 


y 
f g(z) dz — oo as |y| + 00 
0 


Show that every solution is a periodic solution. 


(d) Suppose that g(z) — -g(-z) and let G(y) = fy g(z) dz. Show that the trajec- 
tory through (4,0) is given by 


£9 = X 2[G(A) - G(z1)] 
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(e) Using part (d), show that the period of oscillation of a closed trajectory through 


(A,0) is 


A dy 
T 79 | ay eg 


(f) Discuss how the trajectory equation in part (d) can be used to construct the 
phase portrait of the systein. 


2.19 Use the previous exercise to construct the phase portrait. and study periodic 
solutions for each of the following systems: 


(1) g(z:)=sinz,, (2) g(a) 3123, (3) g(zi) =z] 


In each case, give the period of oscillation of the periodic orbit through the point 
(1,0). 


2.20 For each of the following systems, show that the system has no limit cycles: 


(1) $i = -t +22, fg = g(ti)+ar2, afl 
(2) ij = -gi + r? +r, dy = -T+ T} +r? 
(3) i = - 1132, fg = 2 

(4) $i = T112, i2 = T2 

(5) à = 


t9 cos(21), t? = sinz 
2.21 Consider the system 
£j -£1 + T2(71 +a)—b, t= —cexi(zica) 


where a, b, and c are positive constants with b > a. Let 


D= [se R? | z < —a and sa < 2107] 
(a) Show that every trajectory starting in D stays in D for all future time. 
(b) Show that there can be is periodic orbits ioiak any point x € D. 
2.22 Consider the system 


t= aTi — 2122, t2 = br? — CT2 


where a, b, and c are positive constants with c >a. Let D = {x € R? | z2 > 0}. 
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(a) Show that every trajectory starting in D stays in D for all future time. 


(b) Show that there can be no periodic orbits through any point z € D. 


2.23 ([85]) Consider the system 
2 
$i = Z2 tq = —[2b — g(zi)]az2 —a n 
where a and 5 are positive constants, and 


0, Iz 21 
gqz)-71r [als 


(a) Show using Bendixson's criterion, that there are no periodic orbits if k « 2b. 


(b) Show, using the Poincaré Bendixson criterion, that there is a periodic orbit if 
k > 2b. 


L {r242 <a? 
2,24 Consider a second-order system and suppose that the set M = {a +25 E 3 
has the property that every trajectory starting in M stays in M for all future time. 
Show that M contains an equilibriuin point. 


2.25 Verify Lemma 2.3 by examining the vector fields. 


2.26 ([70]) For each of the following systems, show that the origin is not hyper- 
bolic, find the index of the origin, and verify that it is different from +1: 


0) i = ot, ig = -12 


(2) i = sj- rh 4 


Li 


22122 


2.27 For each of the following systems, find and classify bifurcations that occur 
as p, varies: 


(1) a1 = 2a, da = p(ti +22) —-22—- x} — 3aiz» 

(2) # = rite, = —(14 u2)zi + 2uz2 — pr} + 2(22 — pn) 
(3) $1 = Tp, to = u-22— x — 21122 

(4 #1 = 2a, dg = (+ 2)  2uza + Bet — airo 

(5 ay = Za dy = plt +22) - 22-27 + 3riro 

(6) di = To ip = plti +r2)- T27 x? — 21112 
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2.28 The model that follows is used to analyze the interaction between inhibitory 
and excitatory neurons in a biologica! system [195]. In its simplest form, the model 
describes the interaction of two neurons with z; as the output of the excitatory 


neuron and zz as the output of the inhibitory neuron. The evolution of zı and z2 
is described by 


i -- Ln + tanh(Azi) — tanh(Az2) 
i = - Za + tarih(Ar,) + tanh(Az2) 


where 7 > 0 is a characteristic time constant and \ > 0 is an amplification gain. 


(a) Using the Poincaré-Bendixson criterion, show that the system has a periodic 
orbit when AT > 1. 


(b) Construct the phase portrait for 7 = 1 and A = 2 and discuss the qualitative 
behavior of the system. 


(c) Repeat part (b) for 7 =,1 and A = 1/2. 


(d) Find and classify bifurcations that occur as u = ArT varies. 


2.29 A model that is used to analyze a class of experimental systems known as 


. chemical oscillators [187] is given by 


; 4ziz ! x 
ase-a- fup ein (1-773) 
: 1 1 


where x, and r9 are dimensionaless concentrations of certain chemicals and a, b 
are positive constants. 


(a) Using the Poincaré-Bendixson criterion, show that the system has a periodic 
orbit when b < 3a/5 — 25/a. 


(b) Construct the phase portrait in the first quadrant for a = 10, b = 2 and discuss 
the qualitative behavior of the system. 


(c) Repeat part (b) for a = 10, b = 4. 
(d) Find and classify bifurcations that occur as b varies, while a is fixed. 
2.30 A biochemical reactor can be represented by the model 
; HmT2 3 : Hm? 
di-|-———--—diaz, = d(22¢ - 29) — —— 
1 (s E İz (225 — z2) Y (bs + 29) 


where the state variables and the nonnegative constants d, Hm, km, Y, and zo f are 
defined in Exercise 1.22. Let um = 0.5, km = 0.1, Y = 0.4, and Taj = 4. 
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(a) Find all equilibrium points for d > 0 and determine the type of each point. 
(b) Study bifurcation as d varies. 


(c) Construct the phase portrait and discuss the qualitative behavior of the system 
when d = 0.4. 


2.31 A biochemical reactor can be represented by the model 


em Um » NE ae > Um? 
& (eL a), Ramil tay smi ve ee CAD) 


where the state variables and the nonnegative constants d, Um, km, ki, Y, and ray 
are defined in Exercise 1.22. Let pm = 0.5, km = 0.1, ky = 0.5, Y = 04, and 
Taf = 4. 


(a) Find all equilibrium points for d > 0 and determine the type of each point. 
(b) Study bifurcation as d varies. 


(c) Construct the phase portrait and discuss the qualitative behavior of the system 
when d = 0.1. 


(d) Repeat part (c) when d = 0.25. 
(e) Repeat part (c) when d = 0.5 


Li 


Chapter 3 


Fundamental Properties 


This chapter states some fundamental properties of the solutions of ordinary differ- 
ential equations, like existence, uniqueness, continuous dependence on initial con- 
ditions, and continuous dependence ou parameters. These properties are essential 
for the state equation t = f(t,x) to be a useful mathematical model of a physical 
system. In experimenting with a physical system such as the pendulum, we expect 
that starting the experiment from a given initial state at time to, the system will 
move and its state will be defined in the (at least immediate) future time t > to. 
Moreover, with a deterministic system, we expect that if we could repeat the ex- 
periment exactly, we would get exactly the same motion and the same state at 
t > to. For the mathematical model to predict the future state of the system from 
its current state at to, the initial-value problem 


t= f(t,x),  z(to) = zo i (3.1) 


must have a unique solution. This is the question of existence and uniqueness 
that is addressed in Section 3.1. It is shown that existence and uniqueness can 
be ensured by imposing some constraints on the right-hand side function f(t, £). 
The key constraint used in Section 3.1 is the Lipschitz condition, whereby f(t, x) 
satisfies the inequality! 


IFs) - f) S Lle- vl (3.2) 


for all (t, z) and (t, y) in some neighborhood of (to, xo). 

An essential factor in the validity of any mathematical model is the continuous 
dependence of its solutions on the data of the problem. The least we should expect 
from a mathematical model is that arbitrarily small errors in the data will not result 
in large errors in the solutions,obtained by the model. The data of the initial-value 
problem (3.1) are the initial state rg, the initial time £9, and the right-hand side 


!||- || denotes any p-norm, as defined in Appendix A. 
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nti d initial conditions (to, £o) and on 
i t,x). Continuous dependence on the ini al cc ! ; : 
rene BL of f are studied in Section 3.2. If f is Hd ens boob 
i l lution will be differentiable with resp hes 
to its parameters, then the so : able dac uie 
is is $ in Section 3.3 and is used to derive se 
parameters. This is Shown in Se use : ag aris 
i ] ter variations on the per 
that describe the effect of small parame a 
inuity and differentiability results of Sections 3.2 and 3. 
tem. The continuity and differentiabili ections 3.2 an i 
did on finite time intervals. Continuity results on the os time interval will be 
ili i been introduced.* : 
iven later, after stability concepts have | "A 
“t ihe chapter ends with a brief statement of a comparison Vien un e 
the solution of a scalar differential inequality + < f(t,v) by the solution o 
differential equation à = f(t, u). 


LÀ 


3.1 Existence;and Uniqueness 


In this section, we derive sufficient conditions for the existence and apa 
the solution of the initial-value problem 2 By 1 ager d M ROME pe dm 
in ti : [69,6] — suc. 
to, t;], we mean a continuous function c ort 
S P = f(t, x(t)) for all t € [toti]: If f(z) is continuous in d 2 re 
the solution z(t) will be continuously differentiable. We boi aa t x ed d 
i i i i in t, in which case, a s 

continuous in x, but only piecewise continuous in £, ; 

could only be piecewise continuously differentiable. The assumption that hg = 
piecewise continuous in ¢ allows us to include the case Mon f(t,2) depends on 

i ing i experi changes with time. 

time-varying input that may experience step d 

i A diferential equation with a given initial condition might have several solutions. 
For example, the scalar equation . 


¢=2'/3, with 2(0)=0 (3.3) 


has a solution z(t) = (2t/3)°/?. This solution is not unique, since z(t) =0 : aas 
solution. In noting that the right-hand side of (3.3) is continuous in z, it i n 
that continuity of f(t,x) in its arguments is not sufficient to ae ee ae 
the solution. Extra conditions must be imposed on the function f. he questio : 
existence of a solution is less stringent. In fact, continuity of f (t, z) in its risen 
ensures that there is at least one solution. We will not prove this fact here. i b 
we prove an easier theorem that employs the Lipschitz condition to show existen: 


and uniqueness. 


j Theorem 3.1 (Local Existence and Uniqueness) Let f(t, x) be piecewise con- 
tinuous in t and satisfy the Lipschitz condition : 


IE x) - f) € Lle- yll 


2See, in particular, Section 9.4. 
3See [135, Theorem 2.3] for a proof. 


nS ta o. kias ` 
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Va,ye B= {re R" | lle- xol <r}, Vie [losti]. Then, there exists some ó20 
such that the state equation è = f(t, x) with z(tg) = xg has a unique solution over 
[to, to + ô]. o 


Proof: See Appendix C.1. 


The key assumption in Theorem 3.1 is the Lipschitz condition (3.2). A function 
satisfying (3.2) is said to be Lipschitz in x, and the positive constant L is called a 
Lipschitz constant. We also use the words locally Lipschitz and globally Lipschitz to 
indicate the domain over which the Lipschitz condition holds. Let us introduce the 
terminology first for the case when f depends only on zx. A function f(x) is said 
to be locally Lipschitz on a domain (open and connected set) D C R" if each point 
of D has a neighborhood Do such that f satisfies the Lipschitz condition (3.2) for 
all points in Dg with some Lipschitz constant Ly. We say that f is Lipschitz on a 
set W if it satisfies (3.2) for all points in W, with the same Lipschitz constant L. 
À locally Lipschitz function on a domain D is not necessarily Lipschitz on D, since 
the Lipschitz condition may not hold uniformly (with the same constant L) for all 
points in D. However, a locally Lipschitz function on a domain D is Lipschitz on 
every compact (closed and bounded) subset of D (Exercise 3.19). A function f(z) 
is said to be globally Lipschitz if it is Lipschitz on R^. The same terminology is 
extended to a function f (t,x), provided the Lipschitz condition holds uniformly in 
t for all t in a given interval of time. For example, f(t, x) is locally Lipschitz in x 
on [a,b] x D C Rx R^ if each point x € D has a neighborhood Dy such that f 
satisfies (3.2) on [a,b] x Dg with some Lipschitz constant Lg. We say that f(t,z) 
is locally Lipschitz in z on [to, 00) x D if it is locally Lipschitz in x on [a,b] x D 
for every compact interval [a,b] C (to, oo). A function f (t, z) is Lipschitz in x on 
[a,b] x W if it satisfies (3.2) for all t € [a,b] and all points in W, with the same 
Lipschitz constant L. 

When f : R 5 R, the Lipschitz condition can be written as 
Van fe er , 
N ly arf: RE 


which implies that on a plot of f(z) versus x, a straight line joining any two points 
of f(z) cannot have a slope whose absolute value is greater than L. Therefore, any 
function f(x) that has infinite slope at some point is not locally Lipschitz at that 
point. For example, any discontinuous function is not locally Lipschitz at the point 
of discontinuity. As another example, the function f(z) = z!/3, which was used in 
(3.3), is not locally Lipschitz at z = 0 since f'(z) = (1/3)z7?/3 — oo as z = 0. On 
the other hand, if |f’ (x)| is bounded by a constant k over the interval of interest, 
then f(x) is Lipschitz on the same interval with Lipschitz constant L — k. This 
Observation extends to vector-valued functions, as demonstrated by Lemma 3.1. 


Lemma 3.1 Let f : [a,b] x D + R™ be continuous for some domain D C R^. 
Suppose that [Of /Az] exists and is continuous on [a,b] x D. If, for a convex subset 


90 CHAPTER 3. FUNDAMENTAL PROPERTIES 


W c D, there is a constant L 2.0 such that 


OR 


on [a,b] x W, then i 
F(t, 2) — fta) € Lle- vl 


for all t € [a,b], x € W, and y € W. o 


4 
Proof: Let ||-||p be the underlying norm for any p € [1, oc], and determine q € [1, oo] 
from the relationship 1/p + 1/g = 1. Fix t € [a,b], z € W, and y € W. Define 
(s) = (1— s)z + sy for alla € R such that 7(s) € D. Since W C D is convex, 
(s) € W forü € s € 1. Take z € R™ such that* 


lzl, m 1 and 27 [f(t,y) - f(t,2)] = 1 (63) - Fl a) 


Set g(s) = 27 f(t, 7(s)). Since g(s) is a real-valued function, which is continuously 
differentiable in an open interval that includes [0, 1], we conclude by the mean value 
theorem that there is s; € (0, 1) such that 


g).— 9(0) = gs) 


Evaluating g at 8 = 0, s = 1, and calculating g'(s) by using the chain rule, we 


obtain 


PL quae) - 2) 


Letter] lu als < 1a al 


zT [F(t y) — f(t,2)] 
f(t, y) = F(t,2)llp 


lizlla 


I^ 


where we used the Holder inequality |z7w| < ||zllellwllp- n 


The lemma shows how a Lipschitz constant can be calculated using knowledge 

of [Of /82]. ; : E" ; 
The Lipschitz property of a function is stronger than continuity. It can y 

- easily seen that if f(a) is Lipschitz on W, then it is uniformly continuous n 
(Exercise 3.20). The converse is not true, as seen from the function f(x) 2 x1, 


which is continuous, but not locally Lipschitz at £ = 0. The Lipschitz property is 


weaker than continuous differentiability, as stated in the next lemma. 


domain D C R^, then f is locally Lipschitz in x on [a,b] x D. 


n 
Auch 5 always exists, (Seo Exerche 3.21.) 


2 If (6a). and [8 /0x)(t.2): are. continuous on [a,b] x D, for "ne 
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Proof: For rg € D. let r be so small that the ball Do = {2 € R" | ||z — roll € r} 
is contained in D. The set Do is convex and compact. By continuity, [Of /0z] 
is bounded on [a.b] x Do. Let Lo be a bound for ||3f/ðzx|| on [a,b] x Do. By 
Lemma 3.1, f is Lipschitz on [a.b] x Do with Lipschitz constant Lo. Oo 


It is left to the reader (Exercise 3.22) to extend the proof of Lemma 3.1 to prove 
the next lemna. 


Lemma 3.3 If f(t.x) and [Of /Oz|(t. x) are continuous on [a.b] x R^, then f is 
globally Lipschitz in x on [a.b] x R” if and only if [Of /Ox] is uniformly bounded on 
la, b] x R^. © 


Example 3.1 The function 


f(x) = | ~£; + T1T2 | 


T2 — 2122 
is continuously differentiable on R?. Hence, it is locally Lipschitz on R?. It is not 
globally Lipschitz since [3 f/ðx] is not uniformly bounded on R?. On any compact 


subset of R?, f is Lipschitz. Suppose that we are interested in calculating a Lipschitz 
constant over the convex set W = {x € R? | |zı| € a1, |z2| < a2}. The Jacobian 


matrix is given by 
of E ~l] + r2 Ii 
Ox -I2 1-zi 


Using ||.||os for vectors in R? and the induced matrix norm for matrices, we have 


of 


azl 7 mex(l- 1- za] + leaf, bea) + |1- zal} 


x 


All points in W satisfy 


|-L+2e]+|ri{<l+ag+a, and |zo{+|1—21|<a2+1+a, 


of 
Ox 


and a Lipschitz constant can be taken as L = 1+ a; + a2. A 


Hence, 


<l+a, +a 


x 


Example 3.2 The function 


=| tier ten) | 


is not continuously differentiable on R?. Let us check its Lipschitz property by 
examining f(x) — f(y). Using ||.||2 for vectors in R? and the fact that the saturation 
function sat(-) satisfies 

[sat (4j) — sat (£)] € Jy — €&l 
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4 


we obtain 


f(z) = FaN (z2 — yo)? + (z1- 2 — 9 — ya)? 


(zi = y1)? 2(z1 7 i) (22 — ye) + 2(22 — ye)? 


IA 


Using the inequality 


a Ca 1 1 
o? exea [s E 2l 


we conclude that 


F(z) — f()lla € V2.618 |z — vla, Y z,y e R? 


ore 
| a | 
1A 
> 
3 
& 
— 
st 
ae 
Ne 
ue 
——— 
x 


Here we have used a property of positive semidefinite symmetric matrices; that is, 
a? Px < dmax(P) zz, for all z € R”, where Amax(-) is the maximum eigenvalue of 
the matrix. A more conservative (larger) Lipschitz constant will be obtained if we 
use the more conservative inequality 


a? + 2ab + 2b? < 2a? + 3b? < 3(a? +b?) 
resulting in a Lipschitz constant L = v3. A 


In these two examples, we have used ||-||.. in one case and ||-||2 in the other. Due 
to equivalence of norms, the choice of a norm on R* does not affect the Lipschitz 
property of a function. It only affects the value of the Lipschitz constant (Exer- 
cise 3.5). Example 3.2 illustrates the fact that the Lipschitz condition (3.2) does 
not uniquely define the Lipschitz constant L. If (3.2) is satisfied with some positive 
constant L, it is satisfied with any constant larger than L. This nonuniqueness can 
be removed by defining L to be the smallest constant for which (3.2) is satisfied, 
but we seldom need to do that. ~ 

Theorem 3.1 is a local theorem ince it guarantees existence and uniqueness only 
over an interval [to £o + ô], where ó may be very small. In other words, we have 
no control on 6; hence, we cannot ensure existence and uniqueness over a given 
time interval |to,¢,]. However, one may try to extend the interval of existence by 
repeated applications of the local theorem. Starting at a time to, with an initial 
state z(to) = xo, Theorem 3.1 shows that there is a positive constant ó (dependent 
on Zo) such that the state equation (3.1) has a unique solution over the time interval 
[to, to +ô]. Now, taking to + 6 as a new initial time and z(to + 6) as a new initial 
state, one may try to apply Theorem 3.1 to establish existence of the solution beyond 
to +ô. If the conditions of the theorem are satisfied at (to + ô, z(to + ó)), then there 
exists 52 > 0 such that the equation has a unique solution over [to + ô, to + ó + 6a] 
that passes through the point (to +ô, (tg +6)). We piece together the solutions over 
[to, fo + 6] and (to + 6, to +6 + 63] to establish the existence of a unique solution over 
[to, to +6 +62]. This idea can be repeated to keep extending the solution. However, 
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in general, the interval of existence of the solution cannot be extended indefinitely 
because the conditions of Theorem 3.1 may cease to hold. There is a maximum 
interval [to, T) where the unique solution starting at (to, zo) exists.) In general, T 
may be less than £j, in which case as t 3 T, the sol 


ution leaves any compact set 
over which f is locally Lipschitz in z (Exercise 3.26) : i 


Example 3.3 Consider the scalar system 
$--z?, with z(0) = —1 


The function f(z) = —z? is locally Lipschitz for all z 
on any compact subset of R. The unique solution 


z(t) = + 


€ R. Hence, it is Lipschitz 


exists over [0, 1). As t — 1, x(t) leaves any compact set. A 


The phrase “finite escape time” 
escapes to infinity at a finite ti 
a finite escape time at t = 1. 
In view of the discussion preceding Example 3.3, one may po: i 
question: When is it guaranteed that the solution can be tail pres 
One way to answer the question is to require additional conditions which ensuite 
that the solution z(t) will always be in a set where f(t, zx) is uniformly Lipschitz 
in x. This is done in the next theorem by requiring f to satisfy a global Lipschitz 


condition. The theorem establishes the existence of i i 
a unique solutio 
where t; may be arbitrarily large. : move oe 


is used to describe the phenomenon that a trajectory 
me. In Example 3.3, we say that the trajectory has 


Theorem 3.2 (Global Existence.and.Uni 


} ; ( queness).;: Suppose that x) is piece- 
iG oat Ga | ).-Suppose that f(t, 2) is piece 


M2) (y) S Lle: ul 


Vz,y E'R”, Vte&[tg t]. Then, the state equation 3 i 
, i . quation $ = f(t = 
has a unique solution over [to, tj]. gen ee) P 


Proof: See Appenilix C.1.- 
Example 3.4 Consider the linear system 


t = A(t)z + g(t) = f(t,z) 
where A(t) and g(t) are piecewise continuous functi 
: ons of t. Over any finite interval 
of time [to, ti], the elements of A(t) are bounded. Hence, |A(£)|| € a, where |All is 
any induced inatrix norm. The conditions of Theorem 3.2 are satisfied since 
M (52) - ftt) = WOE Yr VAG V S ra p 


5 1 
Fer a proof of this statement, see [81, Section 8.5] or [135, Section 2.3]. 
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for all z,y € R” and t € [to,t]. Therefore, Theorem 3.2 shows that the linear 
system has a unique solution over {to, tı]. Since tı can be arbitrarily large, we can 
also conclude that if A(¢).and g(t) are piecewise continuous V t > to, then the system 


has a unique solution V £ > tp. Hence, the system cannot have a finite escape time. 
A 


For the linear system of Example 3.4, the global Lipschitz condition of Theorem 
3.2 is a reasonable requirement. This may not be the case for nonlinear systems, in 
general. We should distinguish between the local Lipschitz requirement of Theorem 
3.1 and the global Lipschitz requirement of Theorem 3.2. Local Lipschitz property 
of a function is basically a smoothness requirement. It is implied by continuous 
differentiability. Except for discontinuous nonlinearities, which are idealizations 
of physical phenomena, it is reasonable to expect models of physical systems to 
have locally Lipschitz right-hand side functions. Examples of continuous functions 
that are not locally Lipschitz are quite exceptional and rarely arise in practice. 
The global Lipschitz property, on the other hand, is restrictive. Models of many 
physical systems fail to satisfy it. One can easily construct smooth meaningful 
examples that do not have the global Lipschitz property, but do have unique global 
solutions, which is an indication of the conservative nature of Theorem 3.2. 


Example 3.5 Consider the scalar system 
t= -2° = f(z) 


The function f(x) does not satisfy a global Lipschitz condition since the Jacobian 
8f/dx = —3z? is not globally bounded. Nevertheless, for any initial state z(to) = 
zo, the equation has the unique solution 


2 
i T0 

a(t) = sign(zo A 5:201) 
which is well defined for all t > to. A 

In view of the conservative nature of the global Lipschitz condition, it would be 
useful to have a global existence and uniqueness theorem that requires the function 
f to be only locally Lipschitz. The next theorem achieves that at the expense of 
having to know more about the solution of the system. 


Theorem 3.3 Let f(t,z) be piecewise continuous int and locally Lipschitz in £ 
for all t > to and all z in a domain D C R^. Let W be a compact subse of D, 


To € Ww, and suppose it is known that every solution of 


t= f(t,2), x(t) = To 


lies entirely in W. Then, there is a unique solution that is defined for all t > to. O 
[t] 
D 


» 
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Proof: Recall the discussion oi extending solutions, preceding Example 3.3. By 
Theorem 3.1, there is a unique local solution over [to, to +ô]. Let. [to, T) be its max- 
imal interval of existence. We want to show that T = oo. Recall (Exercise 3.26) 


` the fact that if T is finite. then the solution must leave any compact subset of D. 


Since the solution never leaves the compact set W, we conclude that T — oo, O 


The trick in applying Theorem 3.3 is in checking the assumption that every 
solution lies in a compact set witliout actually solving the differential equation. We 
will see in Chapter 4 that Lyapunov's wetliod for studying stability is very valuable 
in that regard. For now, let us illustrate the application of the theorem by a simple 
example. 


Example 3.6 Cousider again tlie system 
è= -1° = f(x) 


of Example 3.5. The function f(z) is locally Lipschitz on R. If, at any instant 
of time, z(t) is positive, the derivative £(t) will be negative. Similarly, if z(t) is 
negative, the derivative i(t) will be positive. Therefore, starting from any initial 
condition z(0) = a, the solution cannot leave the compact set (r € R | |z| < 
jal}. Thus, without calculating the solution, we conclude by Theorem 3.3 that the 
equatioh has a unique solution for all t > 0. A 


3.2 Continuous Dependence on Initial Conditions 
and Parameters 


For the solution of the state equation (3.1) to be of any interest, it must depend 
continuously on the initial state zo, the initial time £o, and the right-hand side 
function f(t,2). Continuous dependence on the initial time to is obvious froin the 
integral expression 1 
x(t) =20+ | f(s,2(s)) ds 

Jta 
Therefore, we leave it as an exercise (Exercise 3.28) and concentrate our attention 
on continuous dependence on the initial state zo and the function f. Let y(t) be 
a solution of (3.1) that starts at y(to) = yo and is defined on the compact time 
interval [to, tı]. The solution depends continuously on yo if solutions starting at 
nearby points are defined on the same time interval and remain close to each other 
in that interval. This statement can be made precise with the € ô argument: Given 
€ > 0, there is 6 > 0 such that for all zy in the ball {x € R? | |z — yoll < 
6}, the equation « = f(t,z) has a unique solution z(t) defined ou [ty, 4i], with 
Z(to) = zo, and satisfies |[z(t) — y(é)|| < € for all t € fto, tı]. Continuous dependence 
on the right-hand side function f is defined similarly, but to state the definition 
precisely, we need a mathematical representation of the perturbation of f. One 
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possible representation is to replace f by a sequence of functions fm, which converge 
uniformly to f as m — oo. For each function fm, the solution of t = fj (t, z) with 
z(to) = Zo is denoted by r,,(t). The solution is said to depend continuously on 
the right-hand side function if z(t) — z(t) as m — oo. This approach is a 
little bit involved, and will not be pursued here. A more restrictive, but simpler, 


mathematical representation is to assume that f depends continuously on a set of , 


constant parameters; that is, f = f(t, z, À), where A € RP. The constant parameters 
could represent physical parameters of the system, and the study of perturbation of 
these parameters accounts for modeling errors or changes in the parameter values 
due to aging. Let z(t, Ao) be a solution of ¢ = f(t,z, Ao) defined on [to, t1], with 
z(to, ào) = zo. The solution is said to depend continuously on A if for any € > 0, 
there is 6 > 0 such that for all À in the ball (A € R? | ||A — Ao|| < 6), the equation 
i = f(t,z,A) has a unique solution x(t, A) defined on [to, t1], with z(to,À) = zo, 
and satisfies ||x(¢, A) — x(t, Ao)|| < € for all t € [to, ti]. 

Continuous dependence on initial states and continuous dependence on parame- 
ters can be studied simultaneously. We start with a simple result that bypasses the 
issue of existence and uniqueness and concentrates on the closeness of solutions. 


Theorem 3.4 Let f(t, x) be piecewise continuous in t and Lipschitz in x on to, ti] x 
W with a Lipschitz constant L, where W C R” is an open connected set. Let y(t) 
and z(t) be solutions of 


ý= f(ty), v(to) = yo 
and 
| ic (2) ghz), z(to) = zo 
such that y(t), z(t) € W for all t € [to,t1]. Suppose that. 


llg(t, x) | Su Y (t, 2) € [to, t1] xW 
for some p > 0. Then, 
y(t) — z(t)ll S |lyo — zoll exp[L(t — to)] + ^ (exp[L(t — to)] - 1) 
V t € [to ti]. o 


Proof: The solutions y(t) and z(t) are given by 


t 
y(t) = w+ f(s.y(s) ds 


t 
zo+ | [f(s,2(s)) + g(s, 2(s))] ds 


Jty 


z(t) 


®See [43, Section 1.3], (75, Section 1.3), or [135, Section 2.5] for results on continuous dependence 
on parameters using this approach. 
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Subtracting the two equations and taking norms yield 


lv -z0 < llo zoll + f I f(s,u(s)) — F(s, 2(8))|] da 
t r 
n f lle(s, «())] ds 
t 
€ yty(t~ to) 4 n Lily(s) - 2(s)|| ds 
to 


where 7 = ||yo — zo||. Application of the Gronwall-Bellman inequality (Lemma A.1) 
to the function ||y(t) — z(t)]| results in 


WO - «01 y+ ult = to) +f Lly no = toenpl t - 9) de 
Integrating the right-hand side by vada. we obtain 
ly(£) - z(£)) S v ult- to) — 7- u(t — to) + yexp[L(t — to)] 
+ [eoe -= s)] ds 


vexp[L(t — to)] + F {exp[L(t — 19)] — 1} 
which completes the proof of the theorem. o 


With Theorem 3.4 in hand, we can prove the next theorem on the continuity of 
solutions in terms of initial states and parameters. 


Theorem 3.5 Let f(t,z,A) be continuous in (t,z, A) and locally Lipschitz in z 
(uniformly in t and A) on [to,ti] x D x (|A — Aoll < c), where D C R” is an open 
connected set. Let y(t, Ao) be a solution of ¢ = f(t,z, Ao) with y(to, Ao) = yo € D. 
Suppose y(t, ào) is defined and belongs to D for all t € [to, ti]. Then, given e > 0 

there is 6 > 0 such that if 


zo- wll <6 and ||A~Agl| <ô 


then there is a unique solution z(t, à) of i = f(&z,À) defined on [to ti], with 
Z(to, A) = zo, and z(t, À) satisfies 


lat, A) = y(t, Aol «&  Vte [tot] 


o 


Proof: By continuity of y(t, Ao) in t and the compactness of [to, ti], we know that 


y(t, Ao) is bounded on [to,t;]. Define a “tube” U around the solution y(t, X 
Figure 3.1) by ution y(t, Ag) (see 
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Figure 3.1: A tube constructed around the solution y(t, Ao). 


U = (2) € [fo] x A" | lle — (539) < €} 


Suppose that U C [to,t1] x D; if not, replace € by &i < € that is small enough 
to ensure that U C [to,t,] x D and continue the proof with &j. The set U is 
compact; hence, f(t, x, A) is Lipschitz in z on U with a Lipschitz constant, say, L. 
By continuity of f in A, for any a > 0, there is 8 > 0 (with 8 < c) such that 


lf (és, 2) - f (tz, ào) «a, V (t, x) € U, v A = Aoll < B 


" 


Take a < € and ||zo — yol| < o. By the local existence and uniqueness theorem, 
there is a unique solution z(t, A) on some time interval [to, to + A]. The solution 
starts inside the tube U, and as long as it remains in the tube, it can be extended. 
We will show thet, by choosing a small enough o, the solution remains in U for 
all t € [to, t1]. In particular, we let r be the first time the solution leaves the tube 
and show that we can make 7 > ti. On the time interval [to, 7], the conditions of 
Theorem 3.4 are satisfied with u = a. Hence, 


l(t, A) = y(t, ào) « exexp[L(t — t9)] + F expl — to)] - 1) 


< a(1+7) exp[L(t — to)] 


Choosing a € eLexp[- L(t; — to)]/(1 + L) ensures that the solution z(t, 4) cannot 
leave the tube during the interval [to, t1]. Therefore, z(t, A) is defined on [to, tı] and 
satisfies ||z(t, A) — y(t, Ao)|| < €. Taking 6 = min{c, 8} completes the proof of the 
theorem. o 
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3.3  Differentiability of Solutions and Sensitivity 
Equations 


Suppose that f(t.z.A) is continuous in (t,z, A) and has continuous first partial 
derivatives with respect to x and A for all (t, z, A) € [to t1] x R” x RP. Let Ag bea 
nominal value of A. and suppose that the nominal state equation 


i= f(t.r.M9). with z(to) = zo 


has a unique solution z(t, Ag) over [to. ti]. From Theorem 3.5, we know that for all 
A sufficiently close to Ag. that is. ||A — Ao|| sufficiently small, the state equation 


t= f(tr,AÀ) with z(tg).— zo 


has a unique solution z(t, A) over [to. t1} that is close to the nominal solution x(t, Ao). 
The continuous differentiability of f with respect to z and A implies the additional 
property that the solution x(t.) is differentiable with respect to A near Ag. To see 
this, write 
t 
z(t,A)=29 + | f(s,2(s,4), 4) ds 


Jtn 


Taking partial derivatives with respect to A yields 


t 
z(t, A) - | pos A). ) za(8, A) + FF (s a(s, 3), ds 


where z(t, A) = [Ox(t,A)/OA] aud [Oxo/8A] = 0, since zo is independent of A. 
Differentiating with respect to t. it can be seen that x(t, A) satisfies the differential 
equation 


Z aalt, A) = A(t,A)z (fA) + B(t,A), zalio, A) = 0 (3.4) 
where DEEA) Df (2,3) 
Rn T 
A(t, à) = = . B(t, A) m ICM 
ox r=ar(t.r) an r=z(t,A) 


For A sufficiently close to Ag. the matrices A(t, A) and B(t, A) are defined on [to, t;]. 
Hence, 2,(t, A) is defined on the same interval. At A = Ag, the right-land side of 
(3.4) depends only on the nominal solution x(t, Ao). Let S(t) = z(t. Ao); then S(t) 
is the unique solution of the equation 


S(t) = A(t. Ao) S(t) + Blt, ào), S(to) = 0 (3.5) 


The function S(t) is called the sensitivity function, and (3.5) is called the sensitivity 
equation. Sensitivity functions provide first-order estimates of the effect of param- 
eter variations on solutions. They cau also be used to approximate the solution 


a 
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A is sufficiently close to its nominal value Ag. For small || — doll, z(t, A) can 


when 
(t, Ao) to obtain 


be expanded in a Taylor series about the nominal solution z 
a(t, A) = z(t, Ao) + S(t)(A — Ao) + higher-order terms 


Neglecting the higher-order terms, the solution z(t, A) can be approximated by 


a(t, X) ~ a(t, Ao) + SEA — à0) - (3.6) 


We will not justify this approximation here. It will be justified in Chapter 10 when 
we study the perturbation theory. The significance of (3.6) is in the fact that knowl- 
edge of the nominal solution and the sensitivity function suffices to approximate the 
solution for all values of À in a (small) ball centered at Ao. 

The procedure for calculating the sensitivity function S(t) is summarized by the 


following steps: 


e Solve the nominal state equation for the nominal solution x(t, Ao). 


e Evaluate the Jacobian matrices 


A(t, o) = 8f(52,9) . Blt») = BA) zi 
az=z(t,A0),A=A0 


Oz \gaz(t,An),A=Av 


e Solve the sensitivity equation (3.5) for S(t). 


' In this procedure, we need to solve the nonlinear nominal state equation and the 
linear time-varying sensitivity equation. Except for some trivial cases, we will be 
forced to solve these equations numerically. An alternative approach for calculating 
S(t) is to solve for the nominal solution and the sensitivity function simultaneously. 
This can be done by appending the variational equation (3.4) with the original state 
equation, then setting À = Ao to obtain the (n + np) augmented equation 


è = fm), zlto) = zo 
‘ | (3.7) 
5 = E NN S+ |? G E : S(to) =D 


which is solved numerically. Notice that if the original state equation is autonomous, 
that is, f(t, £, A) = f(z, à), then the augmented equation (3.7) will be autonomous 
as well. We illustrate the latter procedure by the next example. 


Example 3.7 Consider the phase-locked-loop model 


fi(21, 22) 


di = T2 
= ` fo(xx, 22) 


do -csin xı — (a + bcos z1)za 


wo s.. s oc tà DE. 
` > 5c ` D jer en " ERES 
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and suppose the parameters a, b, aud c have the nominal values ag = 1, bg = 0, and 
co = 1. The nominal system is given by l 


ii = 2 
T2 — sin T] — T2 


1 


The Jacobian matrices [Of /ðx] and [Of /8^] are given by 


M eed 1 
Ox —ccosz, + br sin zi E cus 


a ~[ asse 2 


0A \@a Ob óc —29 —29c0st,; -—sinzi 
Evaluate these Jacobian matrices at the nomi 
ominal = = 
E parameters a = 1, b = 0, and 
of 


Ox 


B | o 1 
nominal —cosz; -1 


8f _ | o > 0 0 
, 8A nominal —Z9 —T2COST] -sinzj 
Let l 
T3 T5 T7 n n. 8z 
Sz = d 
Ti 2 r dz S22 Oz 
i T4 %6 $8 a Ob c nominal 
Then (3.7) is given by 
di = a, zi(0 = zi 
ty = -sint -— fz, x2(0) = z% 
ds = ma, z3(0 = 0 
ty = —z30052; — 24 — 22, z,(0 = 0 
Ts = Ze, zg(0) = 0 
tg = —Ws COST] — To — 23 COSTI, ze(0) = 0 
T = Tg, zz(0) = 0 
dg = —27C00S2, — Tg —Sinzi, zg(0) = 0 


es solution of this equation was computed for the initial state x19 = £29 = 1 
ua Mi shows 23, T5, and £7, which are the sensitivities of x; with respect to 
ip , and c, respectively. Figure 3.2(b) shows the corresponding quantities for z2. 
Inspection of these figures shows. that the solution is more sensitive to variatio: 

in the parameter c than to variations in the parameters a and b. This patt ps 
consistent when we solve for other initial states. : ies 
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Figure 3.2: Sensitivity function for Example 3.7. 


3.4 Comparison Principle 


Quite often when we study the state equation 2 = f(t,z) we need to compute 
bounds on the solution z(t) without computing the solution itself. The Gronwall- 
Bellman inequality (Lemma A.1) is one tool that can be used toward that goal. An- 
other tool is the comparison lemma. ‘It applies to a situation where the derivative of 
a scalar differentiable function v(t) satisfies inequality of the form v(£) < f(t,v(t)) 
for all £ in a certain time interval. Such inequality ís called a differentíal inequality 
and a function v(t) satisfying the inequality is called a solution of the differential 
inequality. The comparison lemma compares the solution of the differential inequal- 
ity (t) € f(t,v(t)) with the solution of the differential equation à = f(t,u). The 
lemma applies even when v(t) is not differentiable, but has an upper right-hand 
derivative Dt v(t), which satisfies a differential inequality. The upper right-hand 
derivative Dt v(t) is defined in Appendix C.2. For our purposes, it is enough to 
know two facts: 


e If v(t) is differentiable at t, then Dt v(t) = b(t). 


e If 
L (t^e h) — v) Sglth), Y he (0. 


and 
jim, g(t, h) = golt) 


then Dt u(t) € go(t). 
The limit h — 0* means that h approaches zero from above. 
Lemma 3.4 (Comparison Lemma) Consider the scalar differential equation 


ù= f(tu) ulto) = uo 
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where f(t,u) is continuous in t and locally Lipschitz in u, for all t > 0 and all 
uE J C R. Let [to. T) (T could be infinity) be the maximal interval of existence 
of the solution u(t). and suppose u(t) € J for allt € [to, T). Let v(t) be a con- 
tinuous function whose upper right-hand derivative D* v(t) satisfies the differential 


ineguality 
D* v(t) € f(t. e(t). — v(to) € uo 


with v(t) € J for allt € [to. T). Then, u(t) < u(t) for all t € [to, T). [o 


Proof: See Appendix C.2. 


Example 3.8 The scalar differential equation 
i-f(r)--üü- z’)z, 2(0)=a 


has a unique solution on (0, £1), for some £4 > 0, because f(z) is locally Lipschitz. 
Let v(t) = z?(t). The function v(t) is differentiable and its derivative is given by 


(t) = 2x(t)2(t) = —227(t) — 2z*(t) < —22°(t) 
Hence, v(t) satisfies the differential inequality 
u(t) € -2v(t), w(0) = a? 
Let u(t) be the solution of the differential equation 
à—-2u, u(0)=a? => u(t) =a” 


Then, by the comparison lemma, the solution z(t) is defined for all t > 0 and 


satisfies 
ja(t)} = Vel) seal, Vero 


Example 3.9 The scalar differential equation 
i-f(tz)--(1-z?)-e', 2x(0)=a 


has a unique solution on (0, 11) for some tı > 0, because f(t, x) is locally Lipschitz 
in z. We want to find an upper bound on {z(t)| similar to the one we obtained 
in the previous example. Let us start with v(t) = z?(t) as in Example 3.8. The 


derivative of v is given by 
(t). 2a(t)e(t) = —2z?(t) — 22*(t) + 2z(t)e' < —2v(t) + 2/v(t)e' 


We can apply the comparison lemma to this differential inequality, but the resulting 
differential equation will not be casy to solve. Instead, we consider a different choice 


RAA A 


A 


RARARAAAA 


^ PAPA 


Y 


GO RARE 


AB AME) 


WUeCCUUCUC CES SC 


JB ROROR OR ROM M 2 


S . ` E wear. me ARN 
104 CHAPTER 3. FUNDAMENTAL PROPERTIES 


of v(t). Let v(t) = |z(t)|. For z(t) # 0, the function v(t) is differentiable and its 
derivative is given by l 

z(t)i(t) 2 a(t) , 

E = -|z(t)|[1 t)] + e 

= VFO por T el + O+ ey 


Since 1 + z?(t) > 1, we have -e(t |(1 + z?(£)] € —|a(t)| and $(£) € —v(£) + e*. On 
the other hand, when x(t) = 0, we have i 


|v(£ + h) — v(t)| - |z(t + h)| 
h h 


1 t+h 
füo) f Werat) = fat) dr 


t+h 
z 5 J f(r,a(r) dr 


I^ 


1 tA 
Ue os z f Ment) - fat dr 


Since f(t,z(t)) is a continuous function of t, given any € > 0 there is ô > 0 such 
that for all |r — t| < 6, |f(r, z(r)) — f(t, z(t))| < e. Hence, for all h < ô, 


1 pith 
if Wen) - fist) an <e 
which shows that 
lim y SE fF(.2(7)) — f(t,2(¢))| dr = 
Thus, Dt u(t) € | f(t,0)| = et whenever z(t) = 0. Hence, for all t € [0,£;), we have 
D*w(t) —v(t)-- ef, v(0) = |a] 
Letting u(t) be the solution of the jiis differential equation 
. t= ute’, u(0)- jal 
we conclude by the comparison lemma that 
v(t) < u(t) = e™'la] + 4 [et -e7*], Vt [0,t)) 


The upper bound on v(t) is finite for every finite £j and approaches infinity only as 
tı — oo. Therefore, the solution x(t) is defined for all t > 0 and satisfies 


Iz(£)) € e"*la]- 4 [et - e7], vino 
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3.5 Exercises 
3.1 For each of the functions f(x) given next, find whether f is (a) continuously 


differentiable; (b) locally Lipschitz; (c) continuous; (d) globally Lipschitz. 


(1) f(z) = z? + |z]. (2) f(x) = z + sgn(z). 
(3) f(z) = sin(z) sgn(z). (4) f(z) = —z + asin(z). 
(8) f(z) = —z + 2|z]. (6) f(x) = tan(z). E 


+ tenh(bz;) — tanh(bzg) 
(7) f(@) = | ans teslis ios tanhlke,) | 


E =z; + a|zo| 
(8) f(z) = | E iid | 


3.2 Let D, = {x € R” | |z|| « r). For each of the following systems, represented 
as $ = f(t,z), find whether (a) f is locally Lipschitz in z on D,, for sufficiently 
small r; (b) f is locally Lipschitz in z on D,, for any finite r > 0; (c) f is globally 
Lipschitz in z: 


(1) The pendulum equation with friction and constant input torque (Section 1.2.1). 
(2) The tunhel-diode circuit (Example 2.1). 


(3) The mass-spring equation with linear spring, linear viscous damping, Coulomb 
friction, and zero external force (Section 1.2.3). 


(4) The Van der Pol oscillator (Example 2.6). 
(5) The closed-loop equation of a third-order adaptive control system (Section 1.2.5). 


(6) The system $ = Az — By (Cz), where A, B, and C arenx n, nx1, and 1 x n 
matrices, respectively, and w(-) is the dead-zone nonlinearity of Figure 1.10(c). 


3.3 Show that if fı : R — Rand f; : R — R are locally Lipschitz, then fi + fa, 
fifa and fa o fı are locally Lipschitz. 


3.4 Let f : R” — R” be defined by 
mp if 9(x)||Kz|| > p > 0 


f(z) = 2j 
a Kr, if g(z)||Kz|| < u 


where g : R” — Ris locally Lipschitz and nonnegative, and K is a constant matrix. 
Show that f(x) is Lipschitz on any compact subset of R^. 


3.5 Let ||- || and ||: [|g be two different p-norms on R”. Show that f : R^ — R™ 
is Lipschitz in || - || if and only if it is Lipschitz in [| - |a. 
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3.6 Let f(t,x) be piecewise continuous in t, locally Lipschitz in z, and 
IF z)] < ki + kala], Y (62) € [to, 00) x R” 


(a) Show that the solution of (3.1) satisfies 
k 
lic (£l < lizoll expla (t — to)] + z {explkz(t — to)] — 1) 


for all t 2 to for which the solution exists. - 


(b) Can the solution have a finite escape time? 


3.7 Let g : R” — R” be continuously differentiable for all x € R” and define f(x) 
by 
fl) = e) 
1+ 9? (x)g(z) 


Show that 2 = f(x), with z(0) = xo, has a unique solution defined for all t > 0. 


3.8 Show that the state equation 


; uo 222 

i = RI 1(0) =a 
: 2x1 

d = -r2+7y r2(0) = 


has a unique solution defined for all t > 0. 

3.9 Suppose that the second-order system $ = f(x), with a locally Lipschitz f(z), 
has a limit cycle. Show that any solution that starts in the region enclosed by the 
limit cycle cannot have a finite escape time. 


3.10 Derive the sensitivity equations for the tunnel-diode circuit of Example 2.1 
as L and C vary from their nominal values. 


3.11 ‘Derive the sensitivity equations for the Van der Pol oscillator of Example 2.6 


„as € varies from its nominal value. Use the state equation in the r-coordinates. 


3.12 Repeat the previous exercise by using the state equation in the z-coordinates. 
3.13 Derive the sensitivity equations for the system 


t = tan"! (azı) — 2,22, i = bx? — czr2 


as the parnmeters a, b. c vary from their nominal values ao = 1. bo = 0. and cp = 1. 
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3.14 Consider the system 


1 
4 = - 7% + auh(Àzi) — tanh(Az2) 


: 1 
a TAY taib(Azi) + tanh(Aza) 


where A and 7 are positive constants. 


(a) Derive the sensitivity equations as À and r vary from their nominal values Ag 
and To. 


(b) Show that r = y zł + x2 satisfies the differential inequality 
l 1 
TEXE-—-rt 2/2 
T 
(c) Using the comparison lemma. show that the solution of the state equation 
satisfies the inequality 
llz(£)lla < «77 (0) [lp + 2V2r(1 — e7*/7) 


3.15 Using the comparison lemma. show that the solution of the state equation 


219 cueste ce 2r, 
la Uer ed l2 


ii = -7I + 


satisfies the inequality 
llla < e" le(0)ll2 + V2 (1 — e7*) 


3.16 Using the comparison lemina. find an upper bound on the solution of the 
scalar equation 
sin£ 


t=-r+ =, 
la? 


z(0) =2 
3.17 Consider the initial-value problem (3.1) and let D C R” be a domain that 


contains z = 0. Suppose z(t), the solution of (3.1), belongs to D for all t > to and 
lf (6 z)lla € L|jzl|a on [to oc) x D. Show that 


(a) 


a [7O20] < 2Lliz(t)llz 


(b) 
\|zoll2 exp[-Ł(t — to)] < ll(t)ll2 < llzolla exp[L(t — to)) 


ft 


f 


Ni 
b 
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d 
3.18 Let y(t) be a nonnegative scalar function that satisfies the inequality 


t 

y) < hyena) + f ematie agr) + ka] dr 
to 

where kı, ke, and kg are nonnegative constants and a is a positive constant that 


satisfies a > ks. Using the Gronwall-Bellman inequality, show that 


y(t) < ke (6-57) y E3 x e echo] 
a- ka 


Hint: Take z(t) = y(t)e2-'? and find the inequality satisfied by z. 


3.19 Let f : R” — R" be locally Lipschitz in a domain D C R”. Let S C D bea 
compact set. Show that there is a positive constant Z such that for all z, y € S, 


f(z) - fQ)Il S Liz — vil 
Hint: The set S can be covered by a finite number of neighborhoods; that is, 
S C N(ayri)U N(ao,72)U --- U N(ax, rk) 
Consider the following two cases separately: 
e x,y € S N(ai,ri) for some i. 
e z,9 £ 51 N(ai, ri) for any i; in this case, ||z — y|| > min; ri. 
In the second case, use the fact that f(x) is uniformly bounded on S. 


3.20 Show that if f : R” — R” is Lipschitz on W C R”, then f(x) is uniformly 
continuous on W. : 


3.21 For any z € R” — (0) and any p € [1, 00), define y € R” by 


2D sigala?) 
yi = ——— Sign(zj 
lille i 


Show that y7z = [|| aud ||y||g = 1, where q € (1,00] is determined from 1/p + 
1/q = 1. For p = œ, find.a vector y such that y7z = |z||;; and |lyli = 1. 


3.22 Prove Lemma 3.3: 


3.23 Let f(x) be a continuously differentiable function that maps a convex domain 
D C R” into E". Suppose D contains the origin z = 0 and f(0) = 0. Show that 


1 : 
f(z) = f dF ar) dez, VzeD 
Jo Ox 


Hint: Set g(a) = f(oz) for 0 € e € 1 and use the fact that g(1)—9(0) = f, g'(e) do. 
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3.24 Let V : Rx R" — R be continuously differentiable. Suppose that V(t,0) 20 
for all ¢ > 0 and 


V(&z) > allel’; 


80V 
rae x) 


Scalzi, Y (tz) € [0,00) x D 
where c; and c4 are positive constants and D C R” is a convex domain that contains 
the origin x = 0. d 
(a) Show that V(t, £) < deql|x(l? for all z € D. 
Hint: Use the representation V(t, 2) = In 2v (t, ox) do x. 
(b) Show that the constants cj and c4 must satisfy 2c, < c4. 
(c) Show that W(t, £) = \/V(t, 2) satisfies the Lipschitz condition 


C. 
IW(tz2) - W(t,21)] < ggl- nli VEZO, Voz; €D 


3.25 Let f(t, 2) be piecewise continuous in t and locally Lipschitz in z on [to, ta] x 
D, for some domain D C R^. Let W be a compact subset of D. Let z(t) be the 


solution-pf  - f(t,r) starting at z(to) = zo € W. Suppose that z(t) is defined 
and z(t) € W for all t € (fo, T), T < t. 


(a) Show that z(t) is uniformly continuous on lto, T). 
(b) Show that z(T) is defined and belongs to W and z(t) is a solution on [to, T]. 
(c) Show that there is ô > 0 such that the solution can be extended to [to T + 6]. 


3.26 Let f(t, x) be piecewise continuous in t and locally Lipschitz in x on Ito, ti] x 
D, for some domain D C R^. Let y(t) be a solution of (3.1) on a maximal open 


interval [to, T) C [to, t)] with T < oo. Let W be any compact subset of D. Show 
that there is some t € [to, T) with y(t) g W. 
Hint: Use the previous exercise. 


rd ([43]) Let xı : R — R” and z2 : R — R” be differentiable functions such 
at 

lzi(a) ~ 22(2 S v. liil) FUE rlt < wi, for i= 1,2 
for a € t € b. If f satisfies the Lipschitz condition (3.2), show that 


eL (t-a) Si 


lei) = 2a) < ete e (a + pa) [EE 


|: fora<t<b 


3.28 Show, under the assumptions of Theorem 3.5, that the solution of (3.1) de- 
pends continuously on the initial time to. 
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3.29 Let f(tz) and its partial derivatives with respect to x be continuous in 
(t,x) for all (t,£) € [to. ti] x R”. Let z(t.n) be the solution of (3.1) that starts at 
(to) = 7 and suppose x(t, n) is defined on [to. ti]. Show that z(t, n) is coutinuously 
differentiable with respect to 7 and find the variational equation satisfied by [Oz/ On). 
Hint: Put y = z — 5 to transform (3.1) into 


y=f(tytn), y(to)=0 
with 7 as a parameter. 


3.30 Let f(t,z) and its partial derivative with respect to z be continuous in (t.r) 
for all (t,£) € Rx R”. Let x(t,a,7) be the solution of (3.1) that starts at z(a) = n 
and suppose that x(t, a, n) is defined on (a,t;]. Show that z(t, a,n) is continuously 
differentiable with respect to a and 7 and let x(t) and z,(t) denote [Az/da] and 
[82/81], respectively. Show that za(t) and zy (t) satisfy the identity 


Talt) + xs (t)f(a.m) 80, Vt € [a,ti] 


3.31 ([43]) Let f : Rx R — R be a continuous function. Suppose that f (t, x) 
is locally Lipschitz and nondecreasing in x for each fixed value of t. Let x(t) bea 
solution of £ = f(¢,z) on an interval [a,b]. If a continuous function y(t) satisfies 
the integral inequality 


y(t) < z(a) + J f(s. y(8)) ds 


for a < t € b, show that y(t) < z(t) throughout this interval. 


Chapter 4 


Lyapunov Stability 


Stability theory plays a central role in systems theory and engineering. There are 
different kinds of stability problems that. arise in the study of dynamical systems. 
This chapter is concerned mainly with stability of equilibrium points. In later 
chapters. we shall see other kinds of stability, such as input-output stability and 
stability of periodic orbits. Stability of equilibrium points is usually characterized 
in the sense of Lyapunov, a Russian mathematician and engineer who laid the 
foundation of the theory, which now carries his name. An equilibrium point is stable 
if all solutions starting at nearby poiuts stay nearby; otherwise, it is unstable. It is 
asymptotically stable if all solutions startiug at nearby points not only stay nearby, 
but also tend to the equilibrium point as time approaches infinity. These notions 
are made precise iu Section 4.1, where the basic theorems of Lyapunov’s method for 
autonomous systems are given. An extension, of the basic theory, due to LaSalle, is 
given in Section 4.2. For a linear tiine-invariant system z(t) = Az(t), the stability 
of the equilibrium point z — 0 can be completely characterized by the location 
of the eigenvalues of A. This is discussed in Section 4.3. In the same section, it 
is shown when and how the stability of an equilibrium point can be determined 
by linearization about that point. In Section 4.4, we introduce class K and class 
KE functions, which are used extensively in the rest of the chapter, and indeed 
the rest of the book. In Sections 4.5 and 4.6, we extend Lyapunov's method to 
nonautonomous systems. In Section 4.5. we define the concepts of uniform stability, 
uniform asymptotic stability, and exponential stability for nonautonomous systems, 
and give Lyapunov's method for testing them. In Section 4.6, we study linear time- 
varying systems and linearization. 

Lyapunov stability theorems give sufficient conditions for stability. asymptotic 
stability, and so on. They do not say whether the given conditions are also nec- 
essary. There are theorems which establish, at least conceptually, that for many 
of Lyapunov stability theorems, the given conditions are indeed necessary. Such 
theorems are usually called converse theorems. We present three converse theorems 
in Section 4.7. Moreover. we use tlie converse theorem for exponential stability to 
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show that an equilibrium point of a nonlinear system is exponentially stable if ie 
only if the linearization of the system about that point has an exponentially stable 
ilibrium at the origin. 
sodes sun, analysis can be used to show boundedness of the qe 
even when the system has no equilibrium points. This is shown in Section j 
where the notions of uniform boundedness and ultimate boundedness are intro- 
duced. Finally, in Section 4.9, we introduce the notion of input-to-state stability, 
which provides a natural extension of Lyapunov stability to systems with inputs. 


4.1 Autonomous Systems 


Consider the autonomous system 
& = f(z) (4.1) 


where f : D — R” is a locally Lipschitz map from a domain Dc R* into R^. 
Suppose Z € D is an equilibriuni point of (4.1); that is, f(z) = 0. Our goal is to 
characterize and study the stability of z. For convenience, we state all dennitions 
and theorems for the case when the equilibrium point is at the origin of R”; that 
is, $ = 0. There is no loss of generality in doing so because any equilibrium point 
can be shifted to the origin via a change of variables. Suppose 2 # 0 and consider 
the change of variables y = x — z. The derivative of y is given by 


" 


j-i$ —f(z)-/(y-z) C gly), where g(0) =0 


In the new variable y, the system: has equilibrium at the origin. Therefore, without 
loss of generality, we wil] always assume that f(x) satisfies f (0) = 0 and study the 


stability of the origin z = 0. 
Definition 4.1 The equilibrium point x — 0 of (4.1) is 
e stable if, for each € > 0, there is 6 = ó(e) > 0 such that 
| le(DI < 5 liso) «e, vt20 
e unstable if it is not stable. 
e asymptotically stable if it is stable and 6 can be chosen such that 
lis(0)] < ô = Jim a(t) =0 
The £-ó requirement for stability takes a challenge-answer form. To demonstrate 


that the origin is stable, then, for any value of e that a challenger may care to desig- 
nate, we must produce a value of ð, possibly dependent on €, such that a trajectory 


starting in a 6 neighborhood of the origin will never leave the e neighborhood. The . 
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three types of stability properties can be illustrated by the pendulum example of 
Section 1.2.1. The pendulum equation 


ii = rz 
$9 = -— asint) — brg 


has two equilibrium points at (zı = 0, z2 = 0) and (z1 =a, z4 = 0). Neglecting 
friction, by sétting b = 0, we have seen in Chapter 2 (Figure 2.2) that trajecto- 
ries in the neighborhood of the first equilibrium are closed orbits. Therefore, by 
starting sufficiently close to the equilibrium point, trajectories can be guaranteed 
to stay within any specified ball centered at the equilibrium point. Hence, the ¢-5 
requirement for stability is satisfied. The equilibrium point, however, is not asymp- 
totically stable since trajectories starting off the equilibrium point do not tend to it 
eventually. Instead, they remain in their closed orbits, When friction is taken into 
consideration (b > 0), the equilibrium point at the origin becomes a stable focus. 
Inspection of the phase portrait of a stable focus shows that the £-ó requirement 
for stability is satisfied. In addition, trajectories starting close to the equilibrium 
point tend to it as £ tends to oo. The second equilibrium point at z1 = 7 is a saddle 
point. Clearly the e-d requirement cannot be satisfied since, for any £ > 0, there is 
always a trajectory that will leave the ball {z € R" | |x — 2| < €) even when z(0) 
is arbitrarily close to the equilibrium point 4. 

Implicit in Definition 4.1 is a requirement that solutions of (4.1) be defined for 
allt > 0.! Such global existence of the solution is not guaranteed by the local 
Lipschitz property of f. It will be shown, however, that the additional conditions 


needed in Lyapunov's theorem will ensure global existence of the solution. This will. 


come as an application of Theorem 3.3. 

Having defined stability and asymptotic stability of equilibrium points, our task 
now is to find ways to determine stability. The approach we used in the pendulum 
example relied on our knowledge of the phase portrait of the pendulum equation. 
Trying to generalize that approach amounts to actually finding all solutions of (4.1), 
which may be difficult or even impossible. However, the conclusions we reached 
about the stable equilibrium point of the pendulum can also be reached by using 
energy concepts. Let us-define the energy of the pendulum £(z) as the sum of 
its potential and kinetic energies, with the reference of the potential energy chosen 
such that E(0) = 0; that is, i 


T) 
E(x) -f asiny dy + 325 = a(1— cosz,) + la? 
When friction is neglected (b = 0), the system is conservative; that is, there is no 
dissipation of energy. Hence, E = constant during the motion of the system or, in 
lIt is possible to change the definition to alleviate the implication of global existence of the 


solution. In [154], stability is defined on the maximal interval of existence [0, £1), without assuming 
that t; = oo. 
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other words, dE/dt = 0 along the trajectories of the system. Since E(x) = c forms 
a closed contour around z = 0 for small c. we can again arrive at the conclusion 
that r = 0 is a stable equilibrium point. When friction is accounted for (b > 0), 
energy will dissipate during the motion of the system, that is, dE/dt € 0 along the 
trajectories of the system. Due to friction, E cannot remain constant indefinitely 
while the system is in motion. Hence, it keeps decreasing until it eventually reaches 
zero, showing that the trajectory tends to z = 0 as ¢ tends to oo. Thus, by examining 
the derivative of E along the trajectories of the system, it is possible to determine 
the stability of the equilibrium point. In 1892, Lyapunov showed that certain other 
functions could be used instead of energy to determine stability of an equilibrium 
point. Let V : D — R be a continuously differentiable function defined in a domain. 
D c R” that contains the origin. The derivative of V along the trajectories of (4.1). 
denoted by V (x), is given by 


V(z) = 3pm - YEA 


i=l 1 
fi(z) 
= BY e. $ ge ] ou TER ) 
fa(z) = 


The derivative of V along the trajectories of a system is dependent on the systein’s 
equation. Hence, V (z) will be different for different systems. If (t: z) is the solution 
of (4.1) that starts at initial state x at time f = 0. then 


V(x) = S V(é(ta) 


t=0 


Therefore, if V(x) is negative, V will decrease along the solution of (4.1). We are 
now ready to state acid stability theorem. 


Then, z = 0.is stable; Moreover; if ^ 


"V(z) « 0 in D= (0) © (44) 


y 
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Figure 4.1: Geometric representation of sets in the proof of Theorem 4.1. 


Proof: Given £ > 0, choose r € (0.¢] such that 
B,- (ze R^ ||z| <r} c D 
Leto = minga- , V(x). Then. a'> 0 by (4.2). Take @ € (0,0) and let 
/ flo m (z € By | V(z) € 8) 


Then, fi is in. the: interior. ‘of: B.” (See Figure 4. Ly "The set: Ny lias the property 
that any trajectory starting in ns at t = 0 stays in Qg for all t > 0. This follows 
from (4.3) since 


V(z(t) <0 => V(r(t)) «V(z(0) <p, Vt20 


“Because (15 is a compact. ‘set,’ iwe conclude from Theorem 3.3 that (4.1) has a 
unique solution defined for all t > 0 whenever z(0) € Ng. As V(z) is continuous 
and V(0) = 0, there is 6 > 0 such that 


del S9 = V(x) <8 


Then, 
Bs C g C B, 
and 
z(0) € Bs = z(0) € Qa = z(t) € Ng = z(t) € B- 
Therefore, 


llz(0) < 6 = [|x()) <r se Yt20 


2This fact can be shown by contradiction. Suppose Ng is not in the interior of By, then there 
is a point p € Ng that lies on the boundary of Br. At this point, V(p) 2 a > 2, but for all 
z € Ng, V(z) € 2, which is a contradiction. 

36 is closed by definition and bounded, since it is contained in Bp. 
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C1 <C2<C3 


Figure 4.2: Level surfaces of a Lyapunov function. 


which shows that the equilibrium point z = 0 is stable. Now, assume that (4.4) 
holds as well. To show asymptotic stability, we need to show that a(t) — 0 as 
t — oo; that is, for every a > 0, there is T > 0 such that ||x(t)|| < a, for all t > T. 
By repetition of previous arguments, we know that for every a > 0, we can choose 
b > 0 such that Na C Ba. ‘Therefore, it is sufficient to show that V(z(t)) — 0 
as t — oo. Since V(z(t)) is monotonically decreasing and bounded from below by 
Zero, , 
V(x(t)) —c20 as t— œ 


To show that c = 0, we use a.contradiction argument. Suppose c > 0. By continuity 
of V(x), there is d > 0 such that By C Ne. The limit V(z(t)) + c > 0 implies that 
the trajectory z(t) lies outside the ball Bg for all t > 0. Let —y = max¢<jjzii<r V (£), 
which exists because the continuous function V(x) has a maximum over the compact 
set (d < ||z|| € r}.4 By (4.4), ~y < 0. It follows that 


t 
V(z(t)) = V(2(0)) + I V(2(r)) dr < V((0) — 3t 


Since the right-hand side will eventually become negative, the inequality contradicts 
the assumption that c > 0. f B 


A continuously differentiable function V(z) satisfying (4.2) and (4.3) is called 
a Lyapunov function. The surface V(x) = c, for some c > 0, is called a Lyapunov 
surface or a level surface. Using Lyapunov surfaces, we notice that Figure 4.2 makes 
the theorem intuitively clear. It shows Lyapunov surfaces for increasing values of 
c. The condition V < 0 implies that when a trajectory crosses a Lyapunoy surface 
V(x) = c, it moves inside the set 2, = {x € R” | V(x) € c) and can never come 
out again. When V < 0, the trajectory moves from one Lyapunov surface to an 
inner Lyapunov surface with a smaller c. As c decreases, the Lyapunov surface 
V(x) = c shrinks to the origin, showing that the trajectory approaches the origin as 


‘See [10, Theorem 4-20]. 
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time progresses. If we only know that V < 0, we cannot. be sure that the trajectory 
will approach the origin,? but we can conclude that the origin is stable since the 
trajectory can be contained inside any ball B, by requiring the initial state z(0) to 
lie inside a Lyapunov surface contained in that. ball. 


A function V (z) satisfying condition (4.2)--that is, (0) ‘= 0 and V (z) >.0 for. 
z # 0—is said to be positive definite. If it satisfies the weaker condition V(z) 2 0. = 
for z # 0, it is said to be positive semidefinite.’ A function V (z) is said to be negative 


definite or negative semidefinite if —V (z) is positive definite or positive semidefi- 
nite, respectively. If V (z) does not have a definite sign as per one of these four cases, 
it is said to be indefinite. With this terminology, we can rephrase Lyapunov’s the- 
orem to say that the: origin is stable if there is a-continuously differentiable positive 


definite function V (z) so that V (z) is negative semidefinite, and it is asymptotically, 


stable if V(x) is negative definite. 
A class of scalar functions for which sign definiteness can be easily checked is 
the class of functions of the quadratic form 


V(z) = T Pz = S. S S 
i=l] j=1 


where P is a real symmetric matrix. In this case, V(x) is positive definite (positive 
semidefinite) if and only if all the eigenvalues of P are positive (nonnegative), which 
is true if and only if all the leading principal minors of P are positive (all princi- 
pal minors of P are nonnegative). If V(x) = x7 Pr is positive definite (positive 
semidefinite), we say that the matrix P is positive definite (positive semidefinite) 
and write P > 0 (P > 0). 


Example 4.1 Consider ' 


V(t) = ar? +2rıT3 + ar? + 4r2T3 + az? 
a 0 1 T1 
= [znzozj]| 0 a 2 z2 | = 2’ Pz 
f 1 2 a T3 


The leading principal minors of P are a, a?, and a(a?—5). Therefore, V (z) is positive 
definite if a > v5. For negative definiteness, the leading principal minors of —P 
should be positive; that is, the leading principal minors of P should have alternating 
signs, with the odd-numbered minors being negative and the even-numbered minors 
being positive. Consequently, V (z) is negative definite if a < — 8. By calculating 
all principal minors, it can be seen that V (z) is positive semidefinite if a > V5 and 
negative semidefinite if a < — v5. For a € (— V5, V5), V (z) is indefinite. A 


Lyapunov’s theorem can be applied without solving the differential equation 
(4.1). On the other hand, there is no systematic method for finding Lyapunov 


5See, however, LaSalle's theorem in Section 4.2 
SThis is a well-known fact in matrix theory. Its proof can be found in [21] or [63]. 
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Figure 4.3: A possible nonlinearity in Example 4.2. 


functions. In some cases, there are natural Lyapunov function candidates like energy 
functions in electrical or mechanical systems. In other cases, it is basically a matter 
of trial and error. The situation, however, is not as bad as it might seem. As we 
go over various examples and applications throughout the book, some ideas and 
approaches for searching for Lyapuriov functions will be delineated. 


Example 4.2 Consider the first-order differential equation 


i = —g(z) 
where g(x) is locally Lipschitz on (—a, a) and satisfies 
g(0) =0; zg(z)>0, Vx X0 and z € (-a,a) 


A sketch of a possible g(r) is shown in F igure 4.3. The system lias an isolated 
equilibrium point at the origin. It is-not difficult in this simple example to see that 
the origin is asymptotically stable, because solutions starting on either side of the 
origin will have to move toward the origin due to the sign of the derivative t. To 
arrive at the same conclusion using Lyapunov's theorem, consider the function 


V(x) = Eo dy 


Over the domain D = (—a, a), V(z) is continuously differentiable, V(0) = 0. and 
V(x) > 0 for all z # 0. Thus, V(z) is a valid Lyapunov function candidate. To 
see whether or not V(z) is indeed a Lyapunov function, we calculate its derivative 
along the trajectories of the system. 


V) = C -g(2)] = -9%(2) <0, Yz € D- (0) 


Hence, by Theorem 4.1 we conclude that the origin is asymptotically stable. A 
Example 4.3 Consider the pendulum equation without friction, namely, . 


di = 2 


d = — asini 


4.1. AUTONOMOUS SYSTEMS 119 
and let us study the stability of the equilibrium point at the origin. A natural 
Lyapunov function candidate is the energy function 

V(r) = a(1 —cosay) + 423 


Clearly, V(0) = 0 and V(z) is positive definite over the domain —27 < zı «27. 
The derivative of V(x) along the trajectories of the system is given by 


V(x) = at, sin £)  z242 = arz sing) — argsinz; = 0 


Thus, conditions (4.2) and (4.3) of Theorem 4.1 are satisfied, and we conclude that 


- the origin is stable. Since V(x) = 0, we can also conclude that the origin is not 


asymptotically stable; for trajectories starting on a Lyapunov surface V(x) = c 
remain on the same surface for all future time. 


Example 4.4 Consider again the pendulum equation, but this time with friction, 
namely, 


$i = T2 


fo = -— asina; — bag 
Again, let us try V(r) = a(1— cos z1) + (1/2)z2 as a Lyapunov function candidate. 
' V (z) = ak, sins + rgt = — ba? 


The derivative V(r) is negative semidefinite, It is not negative definite because 
V(x) = 0 for za = 0 irrespective of the value of 21; that is, V(x) = 0 along the 
x-axis. Therefore, we can only conclude that tlie origin is stable. However, using 
the phase portrait of the pendulum equation, we have seen that when b > 0, the 
origin is asymptotically stable. The energy Lyapunov function fails to show this 
fact. We will sce later in Section 4.2 that LaSalle's theorem will enable us to arrive 
at a different. conclusion. For now. let ns look for a Lyapunov function V(x) that 
would have a negative definite V(x). Starting from the energy Lyapunov function, 
let us replace the term (1/2)x3 by the more general quadratic form (1/2)z7 Px for 
some 2 x 2 positive definite matrix P: 


V(z) = lz^Pz-a(1- cosz;) 
1 pu p Ti 
= 5 a(l — cos x 
zn aal | pu ms IE ( 1) 


For the quadratic form (1/2)z7 Px to be positive definite, the elements of the matrix 
P must satisfy 
Du»0. pipz pij > 0 
The derivative V(x) is given by 
V(z) (p21 + pia + asin zi ) 2 + (poi + po222) (~a sin xı — bra) 
a(1 = pa2)42 sin Ly — apit sill T+ (mii = pi2b) Tit? + (pia Ti p22b) z 
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Now we want to choose p11, p12, and poo such that V (z) is negative definite. Since 
the cross product terms x2 sin zi and zz are sign indefinite, we will cancel them 
by taking p22 = 1 and pii = bpı2. With these choices, p12 must satisfy 0 < p12 < b 
for V(x) to be positive definite. Let us take pig = b/2. Then, V(x) is given by 


V(z) =— labz, sin zı — ibi 


The term zi sin zı > 0 for all 0 < |z;| < +. Taking D = {x € R? | |ri| < t}, we 
see that V(x) is positive definite and V(x) is negative definite over D. Thus, by 
Theorem 4.1, we conclude that the origin is asymptotically stable. A 


This example emphasizes au important feature of Lyapunov’s stability theorem; 
namely, the theorem’s conditions ure only sufficient. Failure of a Lyapunov function 
candidate to satisfy the conditions for stability or asymptotic stability does not 
mean that the equilibrium is not stable or asymptotically stable. It only means 
that such stability property cannot be established by using this Lyapunov function 
candidate. Whether the equilibrium poiut is stable (asymptotically stable) or not 
can be determined only by further investigation. 

In searching for a Lyapunov function in Example 4.4, we approached the problem 
in a backward manner. We investigated an expression for the derivative V (x) and 
went back to choose the parameters of V(x) so as to make V (zx) negative definite. 
This is a useful idea in searching for a Lyapunov function. A procedure that exploits 
this idea is known as the variable gradient method. To describe the procedure, let 
V(x) be a scalar function of z aud g(x) = VV = (0V/Ox)'. The derivative V(x) 
along the trajectories of (4.1) is given by . 


V(z)- ov F(a) = g^ (2) f(x) 


The idea now is to try to choose g(z) such that it would be the gradient of a positive 
definite function V(x) and, at the same time, V(r) would be negative definite. It 
is not difficult (Exercise 4.5) to verify that g(x) is the gradient of a scalar function 
if and only if the Jacobian matrix [0g/0z] is symmetric; that is, 

Ogi _ 99; 

(seam, Vij=1,... 

ar ae, 57 l..an 
Under this constraint, we start by choosing g(r) such that g"(z)f(x) is negative 
definite. The function V (x) is then computed from the integral 


v) - fo") ay= [ Yat) dyi 


i=1 
The integration is taken over any path joining the origin to z.” Usually, this is done 
along the axes; that is, 


Tı r2 
V(z) Dx n 91(41,0,...,0) ant f g2(x1, y2,0,...,0) dy 
0 : 


"The line integral of a gradient vector is independent of'the path. (See [10, Theorem 10-37].) 
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Tn 
Mee «f 9n(21,22,... Ta 1. n) dyn 


By leaving some parameters of g(x) undetermined, one would try to choose them to 
ensure that V (z) is positive definite. The variable gradient method can be used to 
arrive at the Lyapunov function of Example 4.4. Instead of repeating the example. 
we illustrate the method on a slightly more general system. 2 


Example 4.5 Consider the second-order system 


d = X 
£2 


-h(z1) — are 


where a > 0, h(-) is locally Lipschitz, h(0) = 0, aud yh(y) > 0 for all y#0, ye 
(—b,c) for some positive constants b and c. The pendulum equation is a special 


case of this system. To apply the variable gradient method, we want to choose a 
second-order vector g(x) that satisfies 


2n _ O92 
Or, = Oxy 
V(x) = g (z)z2 - g2(x)[A(x1) + axe] <0, forz#0 
and 
V(x) = n 9" (y) dy > 0, for z #0 
Let us try 


_ | a(z)n +2 
ata) = oe ton] 


where the scalar functions a(:), B(-), yC), and ó(-) 


r are to be determined. To satisfy 
the symmetry requirement, we must have 


ða , 8p ôy ðs 
A(z) + dnt $577 y(x) + Jm + 55 


The derivative V (z) is given by 


V(x) = o(z)ziz2 + B(z)z2 — ay(x)2 129 — aó(r)z2 — (z)zah(zi) — y(x)zi h(z1) 


To cancel the cross-product terms, we choose 
a(z)zi — ay(z)zı — 6(z)h(z1) = 0 
so that 
V(z) = —-[aó(z) — B(x)]zà - ¥(2)xh(21) 
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To simplify our choices, let us take 6(x) = ô = constant, (xz) = y = constant, 
and G(x) = 8 = constant. Then. a(x) depends only on zi, and the symmetry 
requirement is satisfied by choosing 8 = y. The expression for g(x) reduces to 


_ | evi + óh(zi) + yx2 
g(z) = | 72) + ór2 


By integration, we obtain 


zl T2 
V(z) j [ej + éh(gi)] dyi + f (21 + 9y2) dye 
. 0 


E TI T d 
layz? + af h(y) dj + yziz; + $623 = da? Pr + af h(y) dy 
0 0 


where : 
|20 * 

Tm | Y 6 | 

Choosing ô > 0 and 0 < y < aô ensures that V(z) is positive definite and V(r) is 

negative definite. For example, taking y = akô'for 0 < k < 1 yields the Lyapunov 


function š T a 
‘ka? ka 
s| ka d I h(y) dy 


which satisfies conditions (4.2) and (4.4) of Theorem 4.1 over the domain D — {re 
R| -b<m< c}. Therefore, the origin is asymptotically stable. A 


V(z) = 


When «the. origin z. /0.is asymptotically stable, we are often interested in 
determining how far from the origin the. trajectory.can be and still converge.to the. 
origin.as t approaches:oo.: This gives rise to the definition of the region of attraction 
(also called region of asymptotic stability, domain of attraction, or basin). Let ó(t; x) 

be the solution of (4.1) that starts at initial state x at time t = 0. Then, the region 
of attraction is defined as the set of all points x such that ¢(t; x) is defined for all 
t 2 0 and lim: é(t;z) = 0. Finding the exact region of attraction analytically 
might be difficult or even impossible. However, Lyapunov functions can be used 
to estimate the region of attraction, that is, to find sets contained in the region 
of attraction. From the proof of Theorem 4.1, we see that if there is a Lyapunov“ 

‘function that satisfies the conditions of asymptotic stability over a domain D and, 
Af Qe — (z.€ R^. | V(z) € c) is bounded and contained in D, then every trajectory 

‘starting in f); remains.in f), and approaches the origin as.t =œ. Thus, 2, is an 
estimate of the region of attraction. The estimate, however, may be conservative; 
that is, it may be much smaller than the actual region of attraction. In Section 8.2, 
we wil! solve examples on estimating the region of attraction and see some ideas 
to enlarge the estimates. Here, we want to pursue another question: Under what 


conditions will the:region 'of.attraction be the whole space R”? It will be the case if - 


‘we can show that for any initial state x, the trajectory (t; x) approaches the origin 
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Figure 4.4: Lyapunov surfaces for V(x) = z2/(1 + z?) + 23. 


as t — oo, no matter how large ||z|| is. .1f an asymptotically. stable equilibrium 
point at.the origin has this property. it is said to be globally asymptotically stable. 
Recalling again the proof of Theorein 4.1, we can see that global asymptotic stability 
can be established if any point z € R” can be included in the interior of a bounded 
set Ne. It is obvious that for this condition to hold, the conditions of the theorem 
must hold globally, that is, D = R”; but, is that enough? It turns out that we need 
more conditions to ensure that any poiut in R” can be included in a bounded set 
Qe. The probleni is that for large c, the set Qe need not be bounded. Consider, for 


example, the function : 


Ti 2 
— +r 

beat 

Figure 4.4 shows the surfaces V(r) = c for various positive values of c. For small 
c, the surface V(x) = c is closéd; hence, Qe is bounded since it is contained ina 
closed ball B, for some r > 0. This is a consequence of the continuity and positive 
definiteness of V(r). As c increases. a value is reached after which the surface 
V(x) = c is open and 2, is unbounded. For Q, to be in the interior of a ball B,, c 
must satisfy c < infizyr V(x). If 


T 


V(x) = 


= lim inf V(z) «oo 
T= |rll 2r 


then 2, will be bounded if c < l. In the preceding example, 


z? x x? 1 
-l= lim min | —— +23] = lim = 
r>oojjel=r |1 +12 ^^ ^] mio 1 +23 


Thus, Ne is bounded only for c < 1. An extra condition that ensures that Qe is 
bounded for all values of c > 0 is 


V(z) — oo as |z|| + oo 


A function satisfying this condition is said to be radially unbounded. 
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Theorem 4.2. Let z = 0 be anzcquilibrium point for (41).: Let V : R^ ^ R be ae 


continuously differentiable functi n such that ~ 

i V()eoad V()»0, ¥ex0 — —  — 3) 
llz || —.00 => V(z) — 00 (4.6) 
VEs yro (41) 

then z.— 0 is globally asymptotically stable. o 


Proof: Given any point p € R^, let c= V(p). Condition (4.6) implies that for any 
c > 0, there is r > 0 such that V(x) > c whenever ||z|| > r. Thus, f); C Bp, which 
implies that Q, is bounded. The rest of the proof is similar to that of Theorem 4.1. 

l ü 


Theorem 4.2 is known as Barbashin-Krasovskii theorem. Exercise 4.8 gives a 
counterexample to show that the radial unboundedness condition of the theorem is 
indeed needed. 


Example 4.6 Consider again the system of Example 4.5, but this time, assume 
that the condition yh(y) > 0 holds for all y #0. The Lyapunov function 


is positive definite for all z € R? and radially unbounded. The derivative 


V(x) = —aó(1— k)z2 — aókzih(zi) 


is negative definite for all z € R? since 0 € k < 1. Therefore, the origin is globally 
asymptotically stable. : A 


If the origin z = 0 is a globally asymptotically stable equilibrium point of a 
system, then it must: be the unique equilibrium point of the system. For if there 
were another equilibrium point Z, the trajectory starting at z would remain at.Z for 
all £ > 0; hence, it would not approach the origin, which contradicts the claim that 
the origin is globally asymptotically stable. Therefore, global asymptotic stability 
is not studied for multiple equilibria systems like the pendulum equation. 

Theorems 4.1 and 4.2 are concerned with establishing the stability or asymptotic 
stability of an equilibrium point. There are also instability theorems for establishing 
that an equilibrium point is unstable. The most powerful of these theorems is 
Chetaev's theorem, which will be stated as Theorem 4.3. Before we state the 
theorem, let us introduce some terminology that will be used in the theorem's 
statement. Let V : D — R be a continuously differentiable function on a domain 


D C R” that contains the origin z = 0. Suppose V(0) = 0 and there is a point zo. . 
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Figure 4.5: The set U for V(x) = 1(z2 — z3). 


arbitrarily close to the origin such that V (zo) > 0. Choose r > 0 such that the ball 
B, = {x € R" | ||z|| X r) is contained in D, and let 


U = {z € B, | V(z) > 0) (4.8) 


The set U is a nonempty set contained in B,. Its boundary is the surface V(x) = 0 
and the sphere ||x|| =r. Since V(0) = 0, the origin lies on the boundary of U inside 
B,. Notice that U may contain more than one component. For example, Figure 4.5 
shows the set U for V(x) = (x? — z2)/2. The set U can be always constructed 
provided that V(0) = 0 and V(zo) > 0 for some zp arbitrarily close to the origin. 


Theorem 4.3 Let x = 0 be an equilibrium point for (4.1). LetV:D— Rtea 
- continuously differentiable function such that V (0) = 0 and V(zo) > 0 for some xo 
with arbitrarily small ||zo||. Define a set U as in (4.8) and suppose that V(z) >0 
in U. Then, x — 0 is unstable.  : o 


Proof: The point xo is in the interior of U and V (xg) =a > 0. The trajectory 
x(t) starting at x(0) = xo must leave the set U. To see this point, notice that as 
long as x(t) is inside U, V (z(t)) > a, since V(x) > 0 in U. Let 

y = min(V (z) | z € U and V(z) > a} 


which exists since the continuous function V(x) has a minimum over the compact 
set {z € U and V(z) > a) = {x € B, and V(x) > a}.® Then, y > 0 and 


V(z(t)) = V (zo) +f V(z(s)) ds >a Afa ds =a+ yt 


This inequality shows that z(t) cannot stay forever in U because V (x) is bounded 
on'U. Now, x(t) cannot leave U through the surface V(z) = 0 since V(z(t)) > a. 
Hence, it must leave U through the sphere llz|| =r. Because this can happen | for 
an arbitrarily small ||zo||, the origin is unstable. —— a 


There are other instability theorems that were proved before Chetaev's theorem, 
but they are corollaries of the theorem. (See Exercises 4.11 and 4.12.) 


8See [10, Theorem 4-20]. 
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Example 4.7 Consider the second-order system 


ti = ntg(x) 
t2 —z3 + ga(x) 


where gi (-) and go(-) are locally Lipschitz functions that satisfy the inequalities 


ln(z)| < klz, — lox(z)] S &llzli 


ina neighborhood D of the origin. These inequalities imply that 9; (0) = g2(0) = 0. 
Hence, the origin is an equilibrium point. Consider the function 


V(z) (si - 22) 


On the line rz = 0, V(r) > 0 at points arbitrarily close to the origin. The set U is 


shown in Figure 4.5. The derivative of V(x) along the trajectories of the system is 
given by 


V(z) = 2} + 23 + zii (x) — zaga(z) 
The magnitude of the term zig1(z) — x2g2(x) satisfies the inequality 


2 
Iz191(x) — zoga(z)) € >> lil: [gi(z)| < 2kllzll 
i-1 
Hence, 
l V(x) 2 izl? — 2k|zli2 = illl — 2kllzll2) 
Choosing r such that B. C D and r « 1/(2k), it is seen that all the conditions of 
Theorem 4.3 are satisfied. Therefore, the origin is unstable. A 


“Invariance Principle: `: 


In our study of the pendulum equation with friction (Example 4.4), we saw that 
the energy Lyapunov function fails to satisfy the asymptotic stability condition of 
Theorem 4.1 because V(z) = —bz? is only negative semidefinite. Notice, however. 
that V(x) is negative everywhere, except on the line z2 = 0, where V(x) = 0. For 


. the system to maintain the V(z) — 0 condition, the trajectory of the system must 


be confined to the line rz = 0. Unless x, = 0, this is impossible because from tlie 
pendulum equation 


rz2(f)m0 => i2(t)=0 => sina, (t)=0 


Hence, on the segment —7 < x; < 7 of the z2 = 0 line, the system can maintain 
the V(x) = 0 condition only at the origin z = 0. Therefore, V (r(t)) must decrease 
toward 0 and, consequently, z(t) — 0 as t — oo, which is consistent with the fact 
that, due to friction, energy cannot. remain constant while the system is in motion. 
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The foregoing argument shows. formally. that if in a domain about the origin we 
can find a Lyapunov function whose derivative along the trajectories of the systein is 
negative semidefinite. and if we can establish that no trajectory can stay identically 
at points where V(r) = 0. except at the origin, then the origin is asyinptotically 
stable. This idea follows from LaSalle's invariance principle; which is the subject of 
this section. To state aud prove LaSalle's invariance theorem, we need to introduce 
a few definitions. Let z(t) be a solution of (4.1). A point p is said to be a positive 
limit point of x(t) if there is a sequence {tn}, with tn — oo as n — oo, such that 
z(t4) — p as n — oc. The set of all positive limit points of z(t) is called the positive 


limit set of z(t). A set M is said to be an invariant set with respect to (4.1) if 
z(0€M-z(t)eM, VteR 


That is, if a solution belongs to A/ at soine time instant, then it belongs to M for 
all future and past time. A set A is said to be a positively invariant set if 


z(0) € M — z(t) e M, Vt2 0 


We also say that r(t) approaches a set M as t approaches infinity, if for cach € > 0 
there is T > 0 such that 


dist(x(t), M) «e, Vt» T 


where dist(p, M) denotes the distance from a point p to a set M, that is, the smallest 
distance from p to any. point in AJ. More precisely, 


ist(p, M) = inf |p- z 
dist(p, M) A lp — zll 


‘These few concepts can be illustrated by examining an asymptotically stable equi- 
librium point and a stable limit cycle iu the plane. The asymptotically stable 
equilibrium is the positive limit set of every solution starting sufficiently near the 
cquilibrium point. The stable limit cycle is the positive limit set of every solution 
starting sufficiently near the limit cycle. The solution approaches the limit cycle 
as t — oo. Notice, however, that the solution does not approach any specific point 
on the limit cycle. In other words, the statement z(t) approaches M as t — oo 
does not imply that limo; x(t) exists. The equilibrium point and the limit cycle 
are invariant sets. since any solution starting in either set remains in the set for 
allt € R. The set Qe = (ze R" | V(x) € c) with V(r) < 0 for all z € 2, is 
a positively invariant set since, as we saw in the proof of Theorem 4.1, a solution 
starting in Qe remains in Qe for all t > 0. í 

A fundamental property of limit sets is stated in the next lemma, whose proof 
is given in Appendix C.3. i : 


Lemma 4.1 If a solution x(t) of (4.1) is bounded and belongs to D for t > 0, then 
its positive limit set Lt is a nonempty. compact, invariant set. Moreover, x(t) 
approaches L* as t — oo. o 
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We are now ready to state LaSalle’s theorem. 


Theorem 4.4 Let) C D be a. compact set that is positively invariant with respect 
to (4.1). Let V : D > R be a continuously differentiable function such that V (x) < 0 
in fl. Let E be the set of all points in 2 where V(x) = 0. Let M be the largest 
invariant set in E. Then every solution starting in Q approaches M ast —^ oo. © 


Proof: Let z(t) be a solution of (4.1) starting in Q. Since V(z) < 0 in Q, V(z(t)) 
is a decreasing function of t. Since V(x) is continuous on the compact set Q, it is 
bounded from below on Q. Therefore, V (z(1)) has a limit a as t — oo. Note also 
that the positive limit set L* is in Q because Q is a closed set. For any p € L*, there 
is a sequence tn with tn — oo and z(t4) > p as n — oo. By continuity of V(x), 
V (p) = limn—=oo V(z(t4)) = a. Hence, V(z) = a on L+. Since (by Lemma 4.1) Lt 
is an invariant set, V(x) = 0 on L*. Thus, 


L'cMcEcO 


Since x(t) is bounded, z(t) approaches L* as t — oo (by Lemma 4.1). Hence, x(t) 
approaches M as t — oo. 


Unlike Lyapunov's theorem, Theorem 4.4 does not require the function V (x) to 
be positive definite. Note also that the construction of the set f? does not have to be 
tied in with the construction of the function V(x). However, in many applications 
the construction of V (z) will itself guarantee the existence of a set Q. In particular, 
if Qs = {x € R” | V(x) € c} is bounded and V(z) < 0 in Qe, then we can take 
Q= NQ.. When V (z) is positive definite, Q, is bounded for sufficiently small c > 0. 
This is not necessarily true when V(x) is not positive definite. For example, if 
V (a) = (x1 — 22)^, the set 2, is not bounded no matter how small c is. If V(x) is 
radially unbounded—that is, V(z) — oo as ||z|| —^ oo—the set 2, is bounded for 
all values of c. This is true whether or not V (x) is positive definite. 

When our interest is in showing that z(t) — 0 as t — oo, we need to establish 
that the largest invariant set in E is the origin. This is done by showing that 
no solution can stay identically in E, other than the trivial solution z(t) = 0. 
Specializing Theorem 4.4 to this case and taking V(x) to be positive definite, we 
obtain the following two corollaries that extend Theorems 4.1 and 4.2.? 


Corollary 4.1 Let z = 0, be an equilibrium point for (4.1)...Let,V.: D > R bea 


continuously differentiable positive definite. function on a.domain D. containing the 
origin.z = 0; such that V(x) < 0 in 'D. Let S.= (z.€ D | V(x) = 0} and suppose 


that no solution can stay identically in `S, other than the trivial solution x(t) = 0. 
Then; the origin is asymptotically stable. 


3Corollaries 4.1 and 4.2 are known as the theorems of Barbashin and Krasovskii, who proved 
them before the introduction of LaSalle’s invariance principle. 


D 
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Corollary 4.2 Let z = 0 be an equilibrium point, for. (4.1), “Let : 


fis 


V(z) < 0 for all. z: €R”: Let $.— {z€ R? (|. Y (z) 0): and isu 


the origin is globali :asymptotically stable; o 


When V (a) is negative definite, S = {0}. The i inci 
with Theorems 4.1 and 42, bett i H anna Hane 


: Example 4.8 Consider the system 


$i = m, 
—hy(z1) — he(x2) 
where A4 (-) and h2(:) are locally Lipschitz and satisfy 


£9 


h;(0) = 0, yhi(y) >0, V y # 0 and y € (7a, a) 


= system has an isolated equilibrium point at the origin, Depending upon the 

near Ay(-) and h(.), it might have other equilibrium points. The System can 
€ viewed as a generalized pendulum with hz(2) as the friction term. Theref 

& Lyapunov function candidate may be taken as the energy-like function ik 


V(z)- n “haia ls? 


Let D = {z € R? | -a < zi < a}; V(z) is positive definite in D and 
V(z) = hi (zi)za + &2[—hy (21) ~ ha(z5)] = —22h2(r2) < 0 
is negative semidefinite. To find S = (zeD|V(z)- 0), note that 
V (z) =0 = 22he(t2)=0 = T2 —0, since -a <t: <a 
Hence) S= {z € D | z2 =0}. Let x(t) be a solution that belongs identically to $: 
z(t) =0 > io(t)=05 hi(zi(t)) 80 > zi(t) 80 


Therefore, the only solution tha identi 
; j t can stay identically in S i ivi i 
z(t) =0. Thus, the origin is asymptotically stable. MOTUUM ipu: 


Example 4.9 Consider agai 
gain the system of Example 4.8, but this ti = 
and assume that A, (.) satisfies the additional condition: i EAER 


y 
[moa — oo as |y| — oo 


"ng ded gn Ribe a 

continuously differentiable; radially unbounded, positive definite function euch that 
$0 for all ze RL pose that no ` 
solution. can. stay identically in S, other than the trivial solution z(d) = 0... Then. : 
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The Lyapunov function V(z) = n hi(y) dy + (1/2)z2 is radially unbounded. 
Similar to the previous example, it can be shown that V(z) <0 in R?, and the set 


S = {z € R? | V(x) =0} = (ze R? | z2 =0} 


contains no solutions other than the trivial solution. Hence, the origin i 
; i origin is gl 
asymptotically stable. Re m. 


Not only does LaSelle's theorem relax the negative definiteness requirement 
of Lyapunov’s theorem, but it also extends Lyapunov’s theorem in three different 
directions. First, it gives an estimate of the region of attraction, which is not 
necessarily of the form 2, = {z € R” | V(z) < c). The set Q of Theorem 4.4 
can be any compact positively invariant set, We will use this feature in Section 8.2 
to obtain less conservative estimates of the region of attraction. Second, LaSalle’s 
theorem can be used in cases where the system has an equilibrium set, rather than 
an isolated equilibrium point. This will be illustrated by an application to a simple 
adaptive control example from Section 1.2.6. Third, the function V(x) does not 
have to be positive definite. The utility of this feature will be illustrated by an 
application to the neural network example of Section 1.2.5. 


Example 4.10 Consider the first-order system 
$-aytu 
together with the adaptive control law 
u= —ky, k =y, y>0 
Taking x1 = y and r2 = k, the closed-loop system is represented by 


$i = -—(z2—a) 
$3 = yr? 
The line z, = 0 is an equilibrium set. We want to show that the trajectories 


approach this equilibrium set as t — oo, which means that the adaptive controller 
regulates y to zero. Consider the Lyapunov function candidate 


V(z) = dad + zi 


T2-— b)? 

where b >a. The derivative of V along the trajectories of the system is given by 
; sod - 
V(z) = ziii + QU ~ b), = -x1 (z2 — a) + 29 (a2 — b) = -21(b - a) < 0 


Hence, V(x) € 0. Since V(z) is radially unbounded, the set Q, = {x € R? | V(x) < 
c) is a compact. positively invariant set. Thus, taking Q = Qe. all the conditions 
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of Theorem 4.4 are satisfied. The set E is given by E = {x € Qe | zi = 0). 
Because any point on the line à, = 0 is an equilibrium point, E is an invariant set. 
Therefore, in this example, M = E. From Theorem 4.4, we conclude that every 
trajectory starting in Q. approaches E as t — co; that is, zi(t) — 0 as t — oo. 
Moreover, since V(x) is radially unbounded, the conclusion is global; that is, it 
holds for all initial conditions z(0) because for any z(0). the constant c can be 
chosen large enough that z(0) € 2,. A 


Note that the Lyapunov fwiction in Example 4.10 is dependent on a constant 
b, which is required to satisfy b > a. Since in the adaptive control problem the 
constant a is not known, we inay not know the constant 6 explicitly, but we know 
that it always exists. This highlights another feature of Lyapunov's method, which 
we have not seen before; namely. in some situations, we may be able to assert the 
existence of a Lyapunov function that satisfies the conditions of a certain theorem 
even though we may not explicitly know that function. In Example 4.10, we can 
determine the Lvapunov fuuction explicitly if we know some bound on a. For 
example, if we know that |a| < a. where the bound « is known, we can choose 
b»a. 


Example 4.11 The neural network of Section 1.2.5 is represented by ` 


, H ae 
i= cie) » d Mx Hai) thi 
for i = 1,2,...,n, where the state variables z; are the voltages at the amplifier 


outputs. They can only take values in the set 
H={zre R" | — Vay < Ti < Var} 
The functions g; : R > (~Vay, Var) are sigmoid functions, 


hi(zi) = dai >0, Vai € (Va Vm). 


dui ujmgr (ri) 


- I; are constant current inputs, R; > 0, and C; > 0. Assume that the symmetry 


condition T;; = Tj is satisfied. The system may have several equilibrium points in 
H. We assume that all equilibrium points in H are isolated. Due to the symmetry 
property Ti; = T, the vector whose ith component is 


ici 
= Y Tyt- 8 (zi) +1; 
F Ri 


is a gradient vector of a scalar function. By integration, similar to wlat we have 
done in the variable gradient method, it can be shown that this scalar function is 
given by 


bU 
| 
i 
i 
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^ Hence, 
pi d ] 

D) 1 zi d (z2) = 27;2; < 0, for Vay -£ < |z;| < Vary Vi 

" =] PE o 

P V(z)7 — 13^» Tun; + 2 E I g; (y) dy »» Tizi Consequently, trajectories starting in Q(e) will stay in Q(e) for all future time. In 
m i j . x fact, trajectories starting in H — f) (e) will converge to Q(e), implying that all equi- 
A This function is continuously differentiable, but (typically) not positive definite. We n pone lie 5 the eu a ai wi can be ix mars number 
5 rewrite the state equations as of isolated equilibrium points. In Q(c), E = = the set of equilibrium points 


[uw 9 9.9 9.9.9 geo n ONU 


Let us now apply Theorem 4.4 with V (x) as a candidate function. The derivative 
of V (x) along the trajectories of the system is given by 


2 
: AOV. so dg qus | < 
Ei LED (Z) <0 


Moreover, ay 
V(x) = 0 — =0> t =0, Vi 
V(z)=0> Da, i 

Hence, V(r) = 0 only at equilibrium points. To apply Theorem 4.4, we need to 
construct a set 2. Let 


Q(e) = (se R° | - (Var ~€) < ti $ (Var - 9). 


inside Q(e). By Theorem 4.4, we know that every trajectory in Q(e) approaches M 
as t — oo, Since M consists of isolated equilibrium points, it can be shown (Exer- 
cise 4.20) that a trajectory approaching M must approach one of these equilibria. 
Hence, the system will not oscillate. A 


4.8... Linear Systems and Linearization * 


The linear time-invariant system os 
i= Aa - (4.9) 
has an equilibrium point at the origin. The equilibrium point is isolated if and 


: only if det(A) # 0. If det(A) = 0, the matrix A has a nontrivial null space. Every 


point in the null space of A is an equilibrium point for the system (4.9). In other 
words, if det(A):= 0, the system has an equilibrium subspace. Notice that a linear 
system cannot have multiple isolated equilibrium points. For, if 2; and £2 are two 
equilibrium points for (4.9), then by linearity, every point on the line connecting 


: . 2, and 2» is an equilibrium point for the system. Stability properties of the origin 
Pi here e > 0 is arbitrarily small. The set Q(e) is closed and bounded, and V(z) <0 can be characterized by the locations of the eigenvalues of the matrix A. Recall 
ye is Q(e). It remains to show that N(e) is a positively invariant set; that is, every from linear system theory"? that the solution of (4.9) for a given initial state z(0) 
x in Q(e). EAE: impli is gi 

a trajecto starting in Q(e) stays for all future time in Q(e). To simplify the task, is given by 


we assume a specific form for the sigmoid function gi(-). Let 


2Vu -1 ATU; 
gi(ui) = ca tan e 1 A> 0 


Then, 
1 2Vm TI ; 
ii = ghle) [Ens RD (m) id J 
J 


For |zi| > Var — & 


z(t) 2 exp(At)z(0) (4.10) 
and that for any matrix A there is a nonsingular matrix P (possibly complex) that 
transforms A into its Jordan form; that is, 


P-14P = J = block diag|J;, Jo,..., Jp] 


where J; is a Jordan block associated with the eigenvalue A; of A. A Jordan block 


of order one takes the form J; = 4;, while a Jordan block of order m > 1 takes the 
form 


A^; 1 0 .... 0 
0 A 1 0 ... 0 


TTi mV — 2) 0 " 

— }}>tan{ ——,—— ] > xas Ee > J= 

úi (a) " ( 2Vy i i 

Since z; and I; are bounded, £ can be chosen small enough to ensure that s 
0 0 X 


2Vyuzi Tii Ti -e < |z| < Vi 
2 Ts; - "xn e (=) *z;«0, for Vm -E< n M 
J 


mxm 


10See, for example, {9}, [35], [81], [94], or [158]. 
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Therefore, 
exp(At) = Pexp(Jt)P7! = 3 Y ^ t*7! exp(Ait) Rik (4.11) 
` i=l k=1 


where m; is the order of the Jordan block J;. If an n x n matrix A has a repeated 
eigenvalue A; of algebraic multiplicity q;,!! then the Jordan blocks associated with A; 
have order one if and only if rank(A — A;T) = n—qi. The next theorem characterizes 
the stability properties of the origin. 


eig eds and for every. eige walue; with. Re); = 0. and. 
‘rank(A= AJ) li; where n is the dimension of 


Proof: From (4.10), we can see that the origin is stable if and only if exp( At) is 
a bounded function of t for all t > 0. If one of the eigenvalues of A is in the open 
right-half complex plane, the corresponding exponential term exp(A;t) in (4.11) will 
grow unbounded as t — oo. Therefore, we must restrict the eigenvalues to be in the 
closed left-half complex plane. However, those eigenvalues on the imaginary axis 
(if any) could give rise to unbounded terms if the order of an associated Jordan 
block is higher than one, due to the term t*—! in (4.11). Therefore, we must re- 
strict eigenvalues on the imaginary axis to have Jordan blocks of order one, which 
is equivalent to the rank condition rank(A — A,J) = n — qi. Thus, we conclude that 
the condition for stability is a necessary one. It is clear that the condition is also 
sufficient to ensure that exp( At) is bounded. For asymptotic stability of the origin, 
exp(At) must approach 0 as £ — oo. From (4.11), this is the case if and only if 
Re < 0, V i. Since x(t) depends linearly on the initial state z(0), asymptotic 
stability of the origin is global. a 


The proof shows, mathematically, why repeated eigenvalues on the imaginary 
axis must satisfy the rank condition rank(A — AI) = n—q;. The next example may 
shed some light on the physical meaning of this requirement. 


Example 4.12 Figure 4.6 shows a series connection and a parallel connection of 
two identical systems. Each system is represented by the state model 


[peni 


y [ 1 0]z 


i 


where u and y are the input and output, respectively. Let A, and A, be the matrices 
of the series and parallel connections, when modeled in the form (4.9) (no driving 


I Equivalently, q; is the multiplicity of A; as a zero of det(AT — A). 


7 Az is stable if and-only if all: 
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(a) ' (b) 


Figure 4.6: (a) Series connection; (b) parallel connection. 


inputs). Then 


01 00 01 00 
10 00 _|-10 09 
7| o0 o1| 9d 4&=| o0 01 
00-10 10-10 


The matrices A, and A, have the same eigenvalues on the imaginary axis, cj 
with algebraic multiplicity q; = 2, where j = V-I. It can be easily checked that 
rank(Ap— jI) = 2 = n—qi, while rank(A, —-jI)-37zn-q. Thus, by Theorem 45, 
the origin of the parallel connection is stable, while the origin of the series connection 
is unstable. To physically see the difference between the two cases, notice that in 
the parallel connection, nonzero initial conditions produce sinusoidal oscillations 
of frequency 1 rad/sec, which are bounded functions of time. The sum of these 
sinusoidal signals remains bounded. On the other hand, nonzero initial conditions 
in the first component of the series connection produce a sinusoidal oscillation of 
frequency 1 rad/sec, which acts as a driving input for the second component. Since 
the second component has an undamped natural frequency of 1 rad/sec, the driving 
input causes "resonance" and the response grows unbounded. ^ 
When all eigenvalues of A satisfy Red; < 0, A is called a Hurwitz matriz or 
a stability matrix. The origin of (4.9) is asymptotically stable if and only if A 
is Hurwitz. Asymptotic stability of the origin can be also investigated by using 
Lyapunov’s method. Consider a quadratic Lyapunov function candidate 


V(x) =a? Pr 


where P is a real symmetric positive definite matrix. The derivative of V along the 
trajectories of the linear system (4.9) is given by 


V(z) =a? Pt +i" Pr =27(PA+ AT P)z = -27 Qx 
where Q is a symmetric matrix defined by 


PA ATP --Q (4.12) 


a 
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i itive definite, we can conclude by Theorem 4.1 that the origin is asymp- 
re oed that is, ReA; < 0 for all eigenvalues of A. Here we follow hieu 
procedure of Lyapunov's method, where we choose V(z) to be positive definite an 
then check the negative definiteness of V(x). In the case of linear systems, we 2 
reverse the order of these two steps. Suppose we start by choosing Q as a rea 
symmetric positive definite matrix, and then solve (4.12) for P. If (4.12) has a aed 
itive definite solution, then we can again conclude that the origin is asymptotically 
stable. Equation (4.12) is called the Lyapunov equation. The next theorem charac- 
terizes asymptotic stability of the origin in terms of the solution of the Lyapunov 
equation, 

Theorem 4.6 A matriz A is Hurwitz; that is, Red; < 0 for all eigenvalues of A, if 
and only if for any given positive definite symmetric matriz Q there ezists a positive 
definite symmetric matriz P that satisfies the Lyapunov equation (4112): MOS 
if. A i$ Hurwitz, then P. is the unique solution of (4.12). : 

Proof: Sufficiency follows from Theorem 4.1 with the Lyapunov function V(z) = 
zT Pz, as we have already shown. To prove necessity, assume that all eigenvalues 
of A satisfy ReA; « 0 and consider the matrix P, defined by 


P= f * oxp(ATt)Q exp(At) dt (4.13) 
0 


The integrand is a sum of terms of the form t^^! exp(At), where Red; < 0. There- 
fore, the integral exists. The matrix P is symmetric and positive definite. The fact 
that it is positive definite can be shown as follows: Supposing it is not so, there is 
a vector z Æ 0 such that zT Pz = 0. However, 


a’ Pr=0 > n zT exp( AT t)Q exp(At)z dt = 0 
0 
=> exp(At)yg 20, V£ 2 0 > rz 20 


since exp( At) is nonsingular for all t. This contradiction shows that P is positive 
definite. Now, substituting (4.13) in the left-hand side of (4.12) yields 


PA -- ATP 


It 


[a exp( ATt)Q exp(At)A dt + ju AT exp(ATt)Q exp( At) dt 
0 o, 0 


[ T © exp(ATt)Q exp( at) dt = exp(ATt)Qexp(At)]|; = -Q 
0 


which shows that P is indeed a solution of (4.12). To show that it is the unique 
solution, suppose there is another solution P 4 P. Then, 


(P - P)A + AT(P - P) 20 
Premultiplying by exp(A7t) and postmultiplying by exp( At), we obtain 


0 = exv(A")K(P — P)A + ATCP — P)]exp(At) = 5. (exo ATP — P) exp(At)) 
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Hence, . 
exp(A7t)(P ~ P) exp(At) = a constant V t 
In particular, since exp( 40) = J, we have 


(P-P)= exp(ATt)(P — P)exp(At) ^ 0 as t — oo 


Therefore, P = P, "n 


The positive definiteness requirement on Q can be relaxed. It is left to the reader 
(Exercise 4.22) to verify that Q cen be taken as a positive semidefinite matrix of 
the form Q — CTC, where the peir (A, C) is observable. 


Equation (4.12) is a linear algebraic equation that can be solved by rearranging - 


it in the form Mz = y, where z and y are defined by stacking the elements of P 
and Q in vectors, as will be illustrated in the next example. There are numerically 
efficient methods for solving such equations.!? 


Example 4.13 Let 


_|0 -1 _|1 0 _ | Pi P1 
EIE a] e-[ 1 | and P= [m P22 


where, due to symmetry, pj = P21. The Lyapunov equation (4.12) can be rewritten 


as 
0 23 0 ni -1 
-1 -1 1 P |= 0 
|: 0 -2 -2 P22 -1 
The unique solution of this equation is given by 
Pu 1.5 
Pie | = | -05 => P= | E is] 
P22 1.0 i S 


The matrix P is positive definite since its leading principal minors (1.5 and 1.25) 
are Positive. Hence, all eigenvalues of A are in the open left-half complex plane. 


A 


The Lyapunov equation can be used to test whether or not a matrix A is Hurwitz, 
as an alternative to calculating the eigenvalues of A. One starts by choosing a 
positive definite matrix Q (for example, Q = T ) and solves the Lyapunov equation 


(4.12) for P. If the equation has a positive definite solution, we conclude that A 


is Hurwitz; otherwise, it is not so. However, there is no computational advantage 


——— 
12Consult [67] on numerical methods for solving linear algebraic equations. The Lyapunov 


equation can also be solved by viewing it as a special case of the Sylvester equation PA+BP+C = 
0, which is treated in [67]. Almost all commercial software programs for control systems include 
commands for solving the Lyapunov equation. : . 
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in solving the Lyapunov equation over calculating the eigenvalues of A.!? Besides, 
the eigenvalues provide more direct information about the response of the linear 
system. The interest in the Lyapunov equation is not in its use as a stability test 
for linear systems;!^ rather, it is in the fact that it provides a procedure for finding 
a Lyapunov function for any linear system $ = Az when A is Hurwitz. The mere 
existence of a Lyapunov function will allow us to draw conclusions about the system 
when the right-hand side Az is perturbed, whether such perturbation is a linear 
perturbation in the coefficients of A or a nonlinear perturbation. This advantage 
will unfold as we continue our study of Lyapunov's method. 
Let us go back to the nonlinear system 


z= f(z) (4.14) 
where f : D — R” is a continuously differentiable map from a domain D C R" into 
R^. Suppose the origin z = 0 is in D and is an equilibrium point for the system; 
that is, f(0) 2 0. By the mean value theorem, 

8 A 
fle) = A+ Ea 
where z; is a point on the line segment connecting z to the origin. The foregoing 


equality is valid for any point z € D such that the line segment connecting z to tlic 
origin lies entirely in D. Since f(0) = 0, we can write . 


fi e FE aye = Ee + Pe- o] a 
Hence, l 
f(a) = Ax + 92) 
where 


A= FE (o and gi(z) = PI - PA) T 


The function gi(x) satisfies 
9fi afi 
A < |——íz)-— —— 
ls |E- oie 


By continuity of [Df /z], we see that 


lo(s) 
lle 


13A typical procedure for solving the Lyapunov equation, the Bartels-Stewart algorithm [67], 
starts by transforming A into its real Schur form, which gives the eigenvalues of A. Hence, the 
computational effort for solving the Lyapunov equatlon is more than calculating the eigenvalues 
of A. Other algorithms for solving the Lyapunov equation take an amount of computations 
comparable to the Bartels-Stewart algorithm. 

141t might be of Interest, however, to know that one can use the Lyapunov equatlon to derive 
the classical Routh-Hurwitz criterion, (See (35, pp. 417-419].) 
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This suggests that in a small ucighborhood of the origin we can approximate the 
nonlinear system (4.14) by its linearization about the origin 


i= Az, where A= (0) 


The next theorem spells out conditions under which we can draw conclusions about 
the stability of the origin as an equilibrium point for the nonlinear system by in- 
vestigating its stability as an equilibrium point for the linear system. The theorem 
is known as Lyapunov's indirect method. 


Theorem 4.7 Let z —0 be an’ equilibrium point for the nonlinear system 
ES 


where f : D — R" is continuously differentiable and D is a neighborhood of the 
origin. Let 


Then. 
1. The origin is asymptotically stable if Red; <0 for all eigenvalues of A. 
2. The origin is unstable if Red; > 0 for one or more of the eigenvalues of A. 
o 


Proof: To prove the first part. let A be a Hurwitz matrix. Then, by Theorem 4.6, 
we know that for any positive definite symmetric matrix Q, the solution P of the 
Lyapunov equation (4.12) is positive definite. We use V(z) = zT Pz as a Lyapunov 
function candidate for the nonlinear system. The derivative of V(x) along the 
trajectories of the system is given by 


V(r) = 27 Pf(r) +f" (z)Px 

. zT P[Az + g(x)] + [z7 AT + g7 (x)| Px 
aT (PA + AT P)a + 227 Pg(z) 

= -2z'Qr+2r7 Pg(z) 


The first term on the right-hand side is negative definite, while the second term is 
(in general) indefinite. The function g(z) satisfies 


Ilg(=)ll2 


== +0 as liell +0 
EP | 


Therefore, for any y > 0, there exists r > 0 such that 


lale < yhele V Welle <” 
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Hence, . * ias a 
V(z) < 27 Qe + 2y|Pllalizlz, Y llelle 
But 


zT Qz 2 rmin(Q)lizll3 


denotes the minimum eigenvalue of a matrix. Note that Amin(Q 
metric and positive definite. Thus, 


) is 
where Amin(:) 
real and positive since Q is sym 


V(z) < —[Amin(Q) — 27||Pllallial2, V lele « 


Choosing y < (1/2)Amin(Q)/I|Pll2 ensures that V(x) is negative definite. By Te 
rem 4.1, we conclude that the origin is asymptotically stable. To prove the secon 


part of the theorem, let us consider first the special case when A has no eigenvalues 


on the imaginary axis. If the eigenvalues of A cluster into a group of eigenvalues 


in the open right-half plane and a group of eigenvalues in the open left-half plane, 
then there is a nonsingular matrix T such that!® 


—Ai A 


-1. 
TAT =| 0 A 


where A, and Ag are Hurwitz matrices. Let 


EE! 
z=rs=| 3 | 


where the partition of z is compatible with the dimensions of A; and Az. The 
change of variables z = Tx transforms the system 


& = Ax + g(x) 


into the form 


= +Ajz1+ gi(z) 
Agze + g2(z) 


N 
= 
— 
I 


22 
where the functions g;(z) have the property that for any y > 0, there exists r > 0 
such that i 
lgl) < vllzll2, V llzlla Sr, ¿= 1,2 
The origin z = 0 is an equilibrium point for the system in the z-coordinates. Clearly, 
any conclusion we arrive at concerning the stability properties of z = 0 carries over 


to the equilibrium point z = 0 in the z-coordinates, since T is nonsingular." To 
show that the origin is unstable, we apply Theorem 4.3. The construction of a 


‘There are several methods for finding the matrix T, one of which is to transform the matrix 


A into its real Jordan form [67]. 
töSee Exercise 4.26 for a general discussion of stability preserving maps. 
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function V(z) will be done basically as in Example 4.7, except for working with 
vectors, instead of scalars. Let Q1 and Q» be positive definite symmetric matrices 


of the dimensions of A; and Ag, respectively. Since A, and Az are Hurwitz, we i 
know from Theorem 4.6 that the Lyapunov equations i 
PA + ATP S -Qu i=1,2 ] 
; i 
have unique positive definite solutions Pj and P5. Let 1 
i 
H 
P 0 i 
V(z) = 27 Piz — 21 Pozo = 27 | 0 _P, | z i 
In the subspace z? = 0, V (z) > 0 at points arbitrarily close to the origin. Let i 
U = {z € R^ | |izll2 < r and V(z) > 0) : 
a 
In U, f 
3 
V(z) = -z[(BAi* AT Pa + 227 Pigi(z) E 
— z3 (Pag + A3 P)z2 — 223 Pogo(z) i 
í T T r| Pigi(z) i 
. = zi Qiz1 + 29 Qoze + 2z 
1 Qia + 22 Q222 E \ 
2 Ami (Q1)|| zi (13 + Amin (Q2) |lzall i 
- 2|zllz / IP C2) + Pellg) 
>, (a- 2/254)|zlB 
where 


a = min{Amin(Q1), Amin(Q2)) and f = max(||P. |o, || Palle} 


Thus, choosing y < a/(2\/2) ensures that V (z) > 0 in U. Therefore, by Theo- 
rem 4.3, the origin is unstable. Notice that we could have applied Theorem 4.3 in 


the original coordinates by defining the matrices i P 
B o]; Qi 0 
PITU T ; Q=TT| “I 
É PLE Pos] d 


which satisfy the equation 
PA+A™P=Q 


The matrix Q is positive definite, and V(x) = z^ Pz is positive for points arbitrarily 
close to the origin + = 0. Let us consider now the general case when A may have 
eigenvalues on the imaginary axis, in.addition.to eigenvalues in the open right-half 
complex plane. We can reduce this‘ case to‘the special case’we have just studied 
by a simple trick of shifting the imaginary axis. Suppose A has m eigenvalues with 


sone a che 
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Red; > ô > 0. Then, the matrix [A — (5/2)J] has m eigenvalues in the open right- 
half plane, but no eigenvalues on the imaginary axis. By previous arguments, there 
exist matrices P = PT and Q = QT > 0 such that 


»[i- 3 [a- 5] 7-0 


where V(z) = 27 Pz is positive for points arbitrarily close to the origin. The 
derivative of V (z) along the trajectories of the system is given by 


V(z) = 27(PA+A™P)z +227 Pg(z) | 
= x p (4 = 31) + (4 = fr) P z + 6x7 Pz + 227 Pg(z) 
= z7Qz+6V(z) + 227 Pg(z) 
In the set 


{z € R^ | |lzlla < r and V(z) > 0) 
where r is chosen such that ||9(z)|l2 < vllzlla for |Izll < r, V (z) satisfies 
V (2) > Amin(Q) 21/3 — 2l PllalizllalleG)]la 2 (Amin(Q) ~ 21112) ll 


which is positive for y < (1/2)Amin(Q)/||Pll2- Applying Theorem 4.3 concludes = 
proof. 


Theorem 4.7 provides us with a simple procedure for determining the stability 
of an equilibrium point at the origin. We calculate the Jacobian matrix 


and test its eigenvalues. If Red; < 0 for all i or Red; > 0 for some i, we conclude that 
the origin is asymptotically stable or unstable, respectively. Moreover, the proof 
of the theorem shows that when Red; < 0 for all i, we can also find a Lyapunov 


| dl MEE | 
e Seo Section: 8:1 for further investigation of the critical case when linearization fails. 
j 
CENTER NANIFOLD THEORT 


—nQ oe S e-a 5 rid C9. 
* ` 


4.3. LINEAR SYSTEMS AND LINEARIZATION 143 
Linearizing the system about the origin r = 0 yields 


A= x - = Jac? =o =O 
There is one eigenvalue that lies on the imaginary axis. Hence, linearization fails 
to determine the stability of the origin. This failure is genuine in the sense that the 
origin could be asymptotically stable, stable, or unstable, depending on the value 
of the parameter a. If a « 0, the origin is asyinptotically stable as can be seen from 
the Lyapunov function V(z) = z4, whose derivative V(r) = 4az9 < 0 for x # 0. 
If a = 0, the system is linear and the origin is stable according to Theorem 4.5. 
If a > 0, the origin is unstable as can be seen from Theorem 4.3 and the function 
V (z) = z*, whose derivative V(r) = 4ax? > 0 for z # 0. A 


Example 4.15 The pendulum equation 
i 1 = 42 
$9 = — asiuz; — brz 


has two equilibrium points at (rj = 0, z2 = 0) and (zi = 7, z2 = 0). Let us 
investigate stability of both points by using linearization. The Jacobian matrix is 


given by 
8 8 
of M Be 0 1 
0r | on on | | ac 
oe a ] | | -acoszi —b 


To determine the stability of the origin, we evaluate the Jacobian at x = 0: 


_ 0f TTo 1 
ay vii A 


M2=- b+ j Vb? — 4a 


Ox 
For all a, b > 0, the eigenvalues satisfy Red; « 0.. Consequently, the equilibrium 
point at the origin is asymptotically stable. ‘In the absence of friction (b = 0), both - 
eigenvalues are on the imaginary axis. Thus; we cannot determine the stability of : 
the origin through linearization. We have seen in Example 4.3 that, in this case, the 
origin is a stable equilibrium point as determined by an energy Lyapunov function. 
To determine the stability of the equilibrium point at (z1 = 7, x2 = 0), we evaluate 
the Jacobian at that point. This is equivalent to performing a change of variables 
2j = 71 — 7, 22 = T2 to shift, the equilibrium point to the origin, and evaluating 
the Jacobian [Of /8z] at z = 0: 
= | 0 1 | 
T= e= a -b 


The eigenvalues of A are 
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The eigenvalues of A are 


A12 = a žb} Vb? + 4a 


For all a > 0 and 5 > 0, there is one eigenvalue in the open right-half plane. Hence, 
the equilibrium point at (x1 = 7, rq = 0) is unstable. A 


4.4 Comparison Functions 


As we move from autonomous to nonautonomous systems, one degree of difficulty 
will arise from the fact that the solution of the nonautonomous system $ = f(t, x), 
starting at z(t9) = zo, depends on both t and to. To cope with this new situation, 
we will refine the definitions of stability and asymptotic stability so that they hold 
uniformly in the initial time to. While we can refine Definition 4.1 to achieve tlie 
required uniformity, it turns out that there are more transparent definitions which 
use special comparison functions, known as class K and class KL functions. 


Definition 4.2 A continuous function a : [0, a) — [0, 00) is said to belong to class 
K if it is strictly increasing and a(0) = 0. It is said to belong to class Koo if a = oo 
and a(r) + oo as r 4 oo. 


Definition 4.3 A continuous function B : [0, a) x [0, oo) — [0, 00) is said to belong 
to class KL if, for each fixed s, the mapping B(r, s) belongs to class K with respect 
to r and, for each fixed r, the mapping B(r,s) is decreasing with respect to s and 


B(r.s) +0 as s — oo. 


Example 4.16 


e a(r) = tan"! (r) is strictly increasing since o'(r) = 1/(1 +r?) > 0. It belongs 
to class K, but not to class Ka since limp. a(r) = 7/2 < oo. 


e a(r) = r*, for any positive real number c, is strictly increasing since a’(r) = 
cr^-! > 0. Moreover, lim,..4; a(r) = oo; thus, it belongs to class Koo. 


* a(r) = min{r,r?} is continuous, strictly increasing, and lim, s a(r) = oo. 
Hence, it belongs to class Kæ. Notice that a(r) is not continuously differ- 
entiable at r = 1. Continuous differentiability is not required for a class K 
function. 


e B(r,s) — r/(ksr + 1), for any positive real number k, is strictly increasing in 


T since ap E 1 is 
Or (ksr +1)? 

and strictly decreasing in s since 
2H —l 2 
ög kr <0 


as (ksr + 1)? 
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Moreover, B(r, s) + 0 as s — oo. Therefore, it belongs to class KL. 
e f(r, s) — r^e^*, for any positive real number c, belongs to class KCL. A 


The next lemma states some useful properties of class K and class KEL functions, 
which will be needed later on. The proof of the lemma is left as an exercise for the 
reader (Exercise 4.34). 


Lemma 4.2 Let a, and a be class K functions on [0,a), a3 and ag be class Koo 
functions, and B be a class KL function. Denote the inverse of a; by a;!. Then, 


o aj! is defined on [0, aœ (a)) and belongs to class K. 


ag! is defined on |0, oo) and belongs to class Koo. 


Q1 0 a belongs to class K. 


Q3 o a4 belongs to class Kæ 


a(r, s) = ai(B(ao(r), 8)) belongs to class KL. o 


Class K and class X£ functions enter-into Lyapunov analysis through the next 
two lemmas. 


Lemma 4.3 Let V : D — R be a continuous positive definite function defined on a 
domain D C R* that contains the origin. Let B, C D for some r > 0. Then, there 
exist class K functions a, and a, defined on [0,r], such that 


allil) S V(z) < ox(llzlf) 


for all z € B,. If D = R”, the functions a, and az will be defined on [0, 00) 
and the foregoing inequality will hold for all z € R”. Moreover, if V (x) is cay 
unbounded, then o and az can be chosen to belong to class Koo. 


Proof: See Appendix C.4.- 


For a quadratic positive definite function V (z) = zT Pr, Lemma 4.3 follows from 
the inequalities 
| Amin (P)llzll < 27 Pz < MusCP)lall 


Lemma 4.4 Consider the scalar autonomous differential equation 


=-a(y), y(to) = 


where a is a locally Lipschitz class K function defined on [0,a). For all0 € yo <a, 
this equation has a unique solution y(t) defined for all t > tg. Moreover, 


y(t) = o(yo,t — to) 
where o is a class KL function defined on [0, a) x [0, oo). o 
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Proof: See Appendix C.5. 


We can see that the claim of this lemma is true by examining specific examples, 
scalar equation can be found. For example, if 


where a closed-form solution of the 
ý = —ky, k > 0, then the solution is 


| u(t) = yo exp[—K(t — to)] = a(r, s) = rexp(—ks) 
As another example, if y = —ky?, k > 0, then the solution is 


y(t) 


r 


=> o(r,s)= Baad 


-—M— 
kyo(£ — to) +1 


To see how class K and class KL functions enter into Lyapunov analysis, let us | 


see how they could have been used in the proof of Theorem 4.1. In the proof, we 


wanted to choose f and 6 such:that B. co i iti 
EFO aii 5 8 C B,. Using the fact that a Positive 


ex(llzl) S V(z) < œ(lizl) 
we can choose f < a(r) and ô € az(@). This is so because 


V(z) S8 => o(llzl) € ex(r) € lall <r 
and 
lel S6 = V(z) < a2(6) < 8 


In the same proof, we wanted to show that when V (z) is negative definite, the 
pee zo po to zero as t: tends to infinity. Using Lemma 4.3 we see that 
ere 18 a class X function a3 such that V(r) < — i i 
dieca keie (z) € —es(|z||). Hence, V satisfies the 
V < -a3(az1(V)) 


The comparison lemma (Lemma 3 4) shows that V (z(t)) is b i 
; ded 
of the scalar differential equation a 


¥=—as(az'(y)), y(0) = V(z(0)) 


Lemma 4.2 shows that a3 0a? is a class X function and Lemma 4.4 shows that the 
solution of the scalar equation is y(t) = B(y(0), t), where is a class KL function. 
Consequently, V (z(t)) satisfies the inequality V (z(t)) < A(V ((0)), t), which shows 
that V (z(t)) tends to zero as t tends to infinity. In fact, we can go beyond the proof 
of Theorem 4.1 to provide estimates of ||x(¢)|| that are not provided in that proof. 
The inequality V (z(t)) < V (z(0)) implies that 

4 


ev(lle(t)) < Vel) < V(x(O)) < os(]x(0)]]) 
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Hence, |{x(t)|] € a7 (oo(Iz(0)]])). where ay! o az is a class K function. Similarly, 
the inequality V(z(t)) € 8(V(x(0)). t) implies that 


ox (Ilz(t)]) € V(z(t)) < 2V (2(0)), t) € A(os(liz(0)1]), t) 
Therefore, |[z()] < az! ((aa(Iz(0)]]),£)), where a1! (&(az(r),t)) is a class KL 


function. 


4.5. - Nonautonomous Systems : 
Consider the nonautonomous system 
t= f(t,z) (4.15) 


where f : [0, 00) x D — R” is piecewise continuous in ¢ and locally Lipschitz in z 
on [0, oo) x D, and D C R" is a domain that contains the origin z = 0. The origin 
is an equilibrium point for (4.15) at t = 0 if 


f(t,0)=0, Vt>0 


An equilibrium point at the origin could be a translation of a nonzero equilibrium 
point or, more generally, a translation of a nonzero solution of the system. To see 
the latter point, suppose ğ(T) is a solution of the system 


dy 
g 7 909) 
defined for all r > a. The change of variables 
z-y-g(r) t-Tr—a 
transforms the system into the form 
D = —_ = dı f 
å = g(r, y) - G(r) = glt +a, z + g(t +a)) -Åt +a) = f(t, 2) 


Since 
lt +a) =glt+a, g(t-- a), Yt20 


the origin z-= 0 is an equilibrium point of the transformed system at t = 0. 
Therefore, by examining the stability behavior of the origin as an equilibrium point 
for the transformed system, we determine the stability behavior of the solution 9(7) 
of the original system. Notice that if (7) is not constant, the transformed system 
will be nonautonomous even when the original system is autonomous, that is, even 
when g(r, y) = g(y). This is why studying the stability behavior of solutions in the 
sense of Lyapunov can be done only in the context of studying the stability behavior 
of the equilibria of nonautonomous systerns. 


" 
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E ; Hi hr ints of nonau- Example 4,18 The linear first-order system 
Ü The notions of stability and asymptotic Hino jua eg d iin 

! i those intro . g 

ous systems are basically the same as : 1 : 

v aae systems. The new element here is that, while the solution of € iud = 
: tonomous system depends only on (t — to), the solution of a nonautonomous sy PESE" 


ili ior of the equilibrium 
may depend on both ¢ and £o. Therefore, the stability behavior o q 


has the solution 
point will, in general, be dependent on to. The origin z = 0 is a stable equilibrium 


' ; 
—1 l-t 
is ô = ó(£, to) > 0 such that = x 0 
» point for (4.15) if, for each € > 0, and any to > 0 there is 6 zi (E, to) z(t) = z(to)exp A dr } = z(to) 1t 
Li 2 
p lz(to)l| < 8 = lix (t)]]| <E, VE2 to Since [z(t)| < |z(tp)|, Vt > to, the origin is clearly stable. Actually, given any 
. tye 1 1 H , t . " 
V The constant 6 is, in general, dependent on the initial time £g. The pori en) € > 0, we can choose ó independent of to. It is also clear that 
v for every to does not necessarily guarantee that Eo phus eek) HS a(t) — 0 as t — oo 
1) only on e, that would work for all to, as illustrated by the nex l 
E Consequently, according to Definition 4.1, the origin is asymptotically stable. No- 
w Example 4.17 The linear first-order system tice, however, that the convergence of x(t) to the origin is not uniform with respect 
x t = (Otsint — 2t)z to the initial time tg. Recall that convergence of z(t). to the origin is equivalent to 
i£ 


mé 


saying that, given any e » 0, there is T — T(é, to) > 0 such that |z(t)| < e for all 


P2194 T. Although this is true for every fo, the constant T cannot be chosen 
independent of tọ, A 


mphasize the dependence 


has the solution 


z(to) exp Ke sint — 27) ar| 


, 2 
z (to) exp [6sint — 6t cost — t? — 6sin to + 6to cos to + t$] 


z(t) 


Asa consequence, we need to refine Definition 4.1 to e 
of the stability behavior of the origin on the initial time to. We are interested in a 


refinement that defines stability and asymptotic stability of the origin as uniform 
properties with respect to the initial time,}8 


For any to, the term —t? will eventually dominate, which shows that the exponential - 
term is bounded for all t > to by a constant c(to) dependent on tg. Hence, Definition 4.4 The equilibrium point x = 0 of (4.15) és 
NI Snel Shee e stable if, for each € > 0, there is à = 5(é,t9) > O such that 
For any € > 0, the choice 6 = &/c(to) shows that the origin is stable. Now, ae 
to takes on the successive values to = 2nz, for n = 0,1,2,..., and z(t) is evaluate 
T seconds later in each case. Then, 


lz(to)]| < 6 = |Ix(z)I| < e, Vt2iy20 (4.16) 


t 


e uniformly stable if, for each e > 0, there is § = êle) > 0, independent of to, 
such that (4.16) is satisfied. 
2(to + 7) =.2(to) exp [(4n + 1)(6 — 2) a] 


"y e unstable if it is not stable. 
which implies that, for x(to) # 0, 


; e asymptotically stable if it is stable and there is a positive constant c = c(t) 
z(to +7) E re such that x(t) — 0 ast + oo, for all ||x(to)|| < c. 
2(to) : !8See [72] or [95] for other refinements of Definition 4.1. It is worthwhile to note that, for 
. . . isfy the stabilit autonomous systems, the definition of global uniform asymptotic stability given here is equivalent 
Thus, given € > 0, there is no ô independent of to that would satisfy rd to global asymptotic stability as defined in Section 4.1 i 
requirement uniformly in to. such that lime oo 5(€) = oo. This is shown in the pro 


that, when the origin of an autononious system is 


satisfies |[z(t)|| < B(llz(to)]l, 0) for aH z(to), where B(r, 


; : i f so appear in studying asymptotic sta- 0) is a class Koo function. The function 
Nonuniformity with respect to tọ could also app óe) can be taken as BO) ote ge É 


bility of the origin, as the next example shows. 
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e uniformly asymptotically stable if it is uniformly stable and there is a positive 
constant c, independent of to, such that for all ||z(to)]| < c, z(t) — 0 as 
: " oo, uniformly in to; that is, for each n > 0, there is T = T(n) > 0 such 

a 


lz(£))] «m. Y t2 to +T), V |lx(to)] < c (4.17) 


e globally uniformly asymptotically stable if it is uniformly stable, 6(€) can be 
chosen to satisfy limg—soo ó(&) = oo, and, for each pair of positive numbers 7 
and c, there is T = T(n,c) > 0 such that 


lU «m. Vt>to+T(n0), V liz(to)l «c (4.18) 


. The next lemma gives equivalent, more transparent, definitions of uniform sta- 
bility and uniform asymptotic stability by using class K and class KL functions. 


Lemma 4.5 The equilibrium point x = 0 of (4.15) is 


e uniformly stable if and only if there exist a class K function a and a positive 
constant c, independent of tg, such that 


lic) < alleo), Yt to 20, V|iz(to)) «c `` (419) 


e uniformly asymptotically stable if and only if there exist a class KL function 
B and a positive constant c, independent of to, such that 


lz(t)]] < &liz(to) t — to), Vtztoz0, Vlz(to)] «c (4.20) 


P globally uniformly asymptotically stable if and only if inequality (4.20) is sat- 
isfied for any initial state x(to). o 


Proof: See Appendix C.6. 


As a consequence of Lemma 4.5, we see that in the case of autonomous systems 
stability and asymptotic stability per Definition 4.1 imply the existence of class K 
and class KL functions that satisfy inequalities (4.19) and (4.20). This is the case 
because, for autonomous systems, stability and asymptotic stability of the origin 
are uniform with respect to the initial time to. 
or A special case of uniform asymptotic stability arises when the class KZ function 

Bin (4.20) takes the form f(r,s) = kre~**. This case is very important and will 
be designated as a distinct stability property of equilibrium points. 
Definition 4.5 The equilibrium point z.— 0 of (4.15) is exponentially stable if there 
“exist positive constants c, k; and À such that: f l 
"list < kleito leto, vlet <e (4.21) 
and globally exponentially stable if (4.21) is satisfied for any initial state z (to). 
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Lyapunov theory for autonomous systems can be extended to nonautonomous 
systems. For each of Theorems 4.1 through 4.4, one can state various extensions to 
nonautonomous systems. We will not document all these extensions here.!? Instead, 
we concentrate on uniform stability and uniform asymptotic stability. These are 
the cases we encounter in most nonautonomous applications of Lyapunov's method. 


Theorem 4.8 Let z — 0 be an equilibrium point for (4.15) and D C R” bea 
domain containing z = 0. Let V : (0,0) x D R bea continuously differentiable 


function such that 
Wi(z) € V(t, £) € We(z) (4.22) 


oV | OV 

— + — < 4.23 
AEE ADER (4.23) 
V t 2 0 and V z € D, where Wi(z) and W2(z) are continuous positive definite 


functions on D. Then, x — 0 is uniformly stable. © 
Proof: The derivative of V along the trajectories of (4.15) is given by 

av i oV 
ðt Ox 
Choose r > 0 and c > 0 such that B, C D and c < minjel=r W(x). Then, 
{x € B; | Wi(z) € c} is in the interior of B,. Define a time-dependent set N, by 


V(t,z)- f(t,z) < 0 


Nee = {x € B, | V(t,x) < c} 
The set 2,¢ contains {x € B. | W2(z) < c) since 
Wa(z) <c> V(t,x)&c 
On the other hand, Nee is a subset of {x € B, | Wi(z) < c) since 


V(t,z) <c> Wi(z) Se 


Thus, 
{z € B, | Wa(z) < c} CMe C (ze Br | Walz) Sc} c B CD 


for all t > 0. These five nested sets are sketched in Figure 4.7. The setup of 
Figure 4.7 is similar to that of Figure 4.1, except that the surface V (t, z) = cis now 
dependent on t, and that is why it is surrounded by the time-independent surfaces 
Wi (z) = c and W2(z) = c. i 

Since V(t, z) < 0 on D, for any to > 0 and any zo € (1a; the solution starting 
at (to, xo) stays in Qie for all t 2 to. Therefore, any solution starting in (z € 


19. yapunov theory for nonautonomous systems is well documented in the literature. Good 
references on the subject include [72] and [154], while good introductions can be found in {201] 


and [135]. 
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MW, <c} 
^ wWso. 


Figure 4.7: Geometric representation of sets in the proof of Theorem 4.8. 


B. | Walz) € c) stays in Qie, and consequently in {x € B, | Wi(z) < c], for all 
future time. Hence, the solution is bounded and defined for all t > tp. Moreover, 
since V < 0, 

V(t,a(t)) < V(to,z(to)), Vt2 to 


By Lemma 4.3, there exist class K functions a, and o», defined on [0, r], such that 
es (liz) € W1(z) < V(t.z) < W2(z) < ao(lizll) 
Combining the preceding two inequalities, we see that 


llz(£)]] < ex (V(62(5)) € oz (V (to, z(to))) € o1" (aa(llz(to)ID) 


Since o1! o œ is a class X function (by Lemma 4.2), the inequality |lz(t)]| < 
D 


az  (ox(|z(to)]|)) shows that the origin is uniformly stable. 


Theorem 4.9 Suppose the assumptions of Theorem 4.8 are satisfied with inequality 
(4.23) strengthened to P B 

E + Ja fit z) € -Wa(z) (4.24) 
Vt 2 0 and V z € D, where W(x) is a continuous positive definite function on D. 
Then, x = 0 is uniformly asymptotically stable. Moreover, if r and c are chosen 
such that B, = (|z| < r} C D and c < minyzy=, Wi(z), then every trajectory 
starting in {x € B, | Wa(z) € c) satisfies 


l(t) < B(lelto)l t- to), Vt2to2o 


for some class KL function B. Finally, if D = R” and W,(z) is radially unbounded, 
then x = 0 is globally uniformly asymptotically stable. o 


Proof: Continuing with the proof of Theorem 4.8, we know that trajectories start- 
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ing in {x € B, | Wo(x) € c} stay in (x € B, | Wi(x) < c) for all t > to. By 
Lemma 4.3, there exists a class K function os, defined on [0, r], such that 


Em E ia, 2) < -Ws(z) < -aslilæll) 


Using the inequality 
V < œlllzl) + az (V) < liell € aslaz (V) < ox(lizll) 


we see that V satisfies the differential inequality S, 
Vs -os(ag!(V)) € -a(V) 


where œ = a3 0 o2! is a class K function defined on [0,r]. (See Lemma 4.2.) 
Assume, without loss of generality,?? that o is locally Lipschitz. Let y(t) satisfy the 
autonomous first-order differential equation 


y= —o(y) y(to) = V(to,z(to)) > 0 
By (the comparison) Lemma 3.4, 


| V(5z()) < y(t), Yt ty 


By Lemme 4.4, there exists a class KL function o(r,s) defined on [0,r] x [0, o0) 
such that 


V(t, z(t) < a(V (to, z(to)),t = to), V V (to, z(to)) € [0, d 
Therefore, any solution starting in (z € B, | We(x) < c) satisfies the inequality 
lel € or'(V(6z(0)) < ei (o(V (to, 2(to)), t — to)) 
(S a7 (o(os(llz(to)]D,t —19)) Œ Alelo), t — to) 


Lemma 4.2 shows that f is a class KL function. Thus, inequality (4.20) is satis- 
fied, which implies that z = 0 is uniformly asymptotically stable. If D = R”, the 
functions 0, a2, and os are defined on [0, oo). Hence, a, and consequently ô, are 
independent of c. As W,(z) is radially unbounded, c can be chosen arbitrarily large 
to include any initial state in {We(x) < c). Thus, (4.20) holds for any initial state, 
showing that the origin is globally uniformly asymptotically stable. o 


201f æ is not locally Lipschitz, we can choose a locally Lipschitz class X function $ such that 
a(r) > B(r) over the domain of interest. Then, V < —2(V), and we can continue the proof with 
B instead of a. For example, suppose a(r) = /r. The function y7 is a class X function, but not 
locally Lipschitz at r = 0. Define 2 as S(r) = r, for r < 1 and B(T) = Vr, for r > 1. The function 
B is class X and locally Lipschitz. Moreover, a(r) > 2(r) for all r > 0. 
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A function V(t, z) is said to be positive semidefinite if V(t,z) > 0. It is said 
to be positive definite if V (t,£) > W, (z) for some positive definite function Wi(z), 
radially unbounded if W, (z) is so, and decrescent if V(t,z) € W(x). A function 
V(t,z) is said to be negative definite (semidefinite) if =V (t,x) is positive definite 
(semidefinite). Therefore, Theorems 4.8 and 4.9 say that the origin is uniformly 
stable if there is a continuously differentiable, positive definite, decrescent function 
V(t, x), whose derivative along the trajectories of the system is negative semidcfinite. 
It is uniformly asymptotically stable if the derivative is negative definite, and globally 
uniformly asymptotically stable if the conditions for uniform asymptotic stability 
hold globally with a radially unbounded V(t, x). E 


"Theorem 4.10 Le 
function’ such that 


an equilibrium point for: (4.18) and D CR" be à 
et Vy [0;00) X:D'— R bea continuously differentiable 


* < V(t 2) < kollel (4.25) 


(4.26) 

Viz 0 and Y £ €D, where ki; kj, ky and a are positive constants. Then, r=0 
„19 exponentially ‘stable. Jf the. assumptions hold globally, then x = 0 is globally 
' s exponentially stable.: >- e o 


Proof: With the help of Figure 4.7, it can be seen that trajectories starting in 
{kq||x||* < c), for sufficiently small c, remain bounded for all t > ty. Inequalities 
(4.25) and (4.26) show that V satisfies the differential inequality 


By (the comparison) Lemma 3.4, 


V(t, x(t)) € V (to, x(to))e- 5/569) 


Hence, 
= ha /a 
V(t, x(t) 1/2 V (to, z (to) Je" *s/&t-t) 7? 
< |—— 
lor s [6 < à 
—(ka/ke)(t—to) 1 1/4 1/ 
< p] = (2) "liz (fo)le- Roseto) 
1 1 


Thus, the origin is exponentially stable. If all the assumptions hold globally, c can 
be chosen arbitrarily large and the foregoing inequality holds for all x(tg) € R^. C 


Example 4.19 Consider the scalar System 


+= -+ othe" 
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where g(t) is continuous and g(t) > 0 for all t > 0. Using the Lyapunov function 
candidate V (z) = z?/2, we obtain 

V(t, z) = -|1 + g(t)jrt < ', VreR, vt20 


The assumptions of Theorem 4.9 are satisfied globally with Wiz) = W(x) = V (z) 
and Wa(z) = z4. Hence, the origin is globally uniformly asymptotically stable. A 


Example 4.20 Consider the systeın 
ij = =x- g(t)r2 
i2 = 2-22 
where g(t) is continuously differentiable and satisfies » 
O<g(t)<k and g(t) < g(t), vt20 


Taking V (t, z) = z2 +[1+9(t)]z3 as a Lyapunov function candidate, it can be easily 


seen that 
x? +3 < V(t £) < 1? + (1k) VzeR 


Hence, V(t, x) is positive definite, decrescent, and radially unbounded. The deriva- 
tive of V along the trajectories of the system is given by 


V(t, £) = —2z2 + 22122 — [2 + 2g(t) - &(0]23 
Using the inequality 
2+ 2g(t) - g(t) 2 2+ 2g(t) - g(t) 22 
we obtain 


T ^ 
" T 2 -1 Ij | def T 
V(z) < -2af + 204m = 228 = = | 1 | | -1 3 p: | = —r' Qr 


where Q is positive definite; therefore, V (t,z) is negative definite. Thus, d the 
assumptions of Theorem 4.9 are satisfied globally with positive definite quadr atic 
functions Wi, We, and Ws. Recalling that a positive definite quadratic function 
T H 
a’ Px satisfies. 
\min(P)a7 2 € zT Pz € \maz(P)z? x 


we see that the conditions of Theorem 4.10 are satisfied globally with a = 2. Hence, 


the origin is globally exponentially stable. A 
Example 4.21 The linear time-varying system 
b= A(t)z (4.27) 


444. ! 
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has an equilibrium point at x = 0. Let A(t) be continuous for all t > 0. Suppose 


there is a continuously differentiable, symmetric, bounded, positive definite matrix 
P(t); that is, 


0<aql< P(t)<el, Vt20 
which satisfies the matrix differential equation 
—P(t) = P(t)A(t) + AT (t) P(t) + Q(t) (4.28) 
where Q(t) is continuous, symmetric, and positive definite; that is, 
Q(t) > el >0, Vt20 
The Lyapunov function candidate 
Vitr) = 2" P(t)z 
satisfies ^ 
call} < V(t, z) < calli 
and its derivative along the trajectories of the system (4.27) is given by 
V(tz) = aT'P(t)z- x7 P(t)t +27 P(t)x 
z"|P(t) + PAC) + AT()P()]e = -z7Q()s < -oslik 


Thus, all the assumptions of Theorem 4.10 are satisfied globally with a = 2, and 
we conclude that the origin is globally exponentially stable. ; A 


4.6 Linear Time-Varying Systems and Linearization 


The stability behavior of the origin as an equilibrium point for the linear time- 
varying system 


a(t) = A(t)z (4.29) 
can be completely characterized in terms of the state transition matrix of the system. 
From linear system theory,?} we know that the solution of (4.29) is given by 

x(t) = P(t, to)z(to) 
where c(t, to) is the state transition matrix. The next theorem characterizes uniform 
asymptotic stability in terms of &(t, to). 


Theorem 4.11 The equilibrium point x = 0 of (4.29) is (globally) uniformly asymp- 
totically stable if and only if the state transition matrix satisfies the inequality 
D(t, toll € ke X79, vt2 to 20 (4.30) 


for some positive constants k and A. - © 


?!See, for example, [9], [35], [94], or [158]. 
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Proof: Due to the linear dependence of x(t) on z(to), if the origin is uniformly 
asymptotically stable, it is globally so. Sufficiency of (4.30) is obvious since 


lætt) < NEE, to) Ih la(to)|| S liz (to)]e 7*9 


To prove necessity, suppose the origin is uniformly sompo stable. Then, 
there is a class KL function 8 such that 


liz (£l < Blz(to)]. t — to), -Y t 2 to, V z(to) € E" 
From the definition of an induced matrix norm (Appendix A), we have 
[Ct toll = max (6 to)al| < max Alle t — to) = ACA, € — to) 
Since 


B(1,5) — 0 as s— oo 


there exists T > 0 such that BUT) < 1/e. For any t > to, let N be the smallest 
positive integer such that t < to + NT. Divide the interval [to, to + (N — 1)7] into 


(N —1) equal subintervals of width T each. Using the transition property of (t, to), 
_ we can write 


P(t, to) = Blt, to + (N — 1)T)8 (to + (N — 1)T, to + (N —2)T) -- (to + T, to) 
Hence, 


k=N~1 f 
Peto) < Ntt N- DT) [T ld + kT, to + k- 17] 
k= 
ESNS Ei i 
< £(1,0) = = ef(1,0)e-" 
k=1 e 


< ef(1,0)e- t—t9)/T = ke Mt to) 


where k = ef(1,0) and à = 1/T. o 


Theorem 4.11 shows that, for linear systems, uniform asymptotic stability of 
the origin is equivalent to exponential stability. Although inequality (4.30) charac- 
terizes uniform asymptotic stability of the origin without the need to search for a 
Lyapunov function, it is not as useful as the eigenvalue criterion we have for linear 
time-invariant systems, because knowledge of the state transition matrix d(t,to) 
requires solving the state equation (4.29). Note that, for linear time-varying sys- 
tems, uniform asymptotic stability cannot be characterized by the location of the 
eigenvalues of the matrix A? as the following example shows. 


Z?There are special cases where uniform asymptotic stability of the origin as an equilibrium point 
for (4.29) is equivalent to an eigenvalue condition. One case is periodic systems. (See Exercise 4.40 
and Example 10.8.) Another case is slowly-varying systems. (See Example 9.9.) 
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Example 4.22 Consider a second-order linear system with 


= 2 
A= | 14+ 1.5cos?t 


1- 1.5sintcost 
—1- l.5sintcost 


—-1-415sin?t 


For each t, the eigenvalues of A(t) are given by —0.25 + 0.25V/7j. Thus, the eigen- 
values are independent of ¢ and lie in the open left-half plane. Yet, the origin is 
unstable. It can be verified that 
e99 cost e`tsint 
$(t,0) = 
—e5tsint e~t cost 


which shows that there are initial states z(0), arbitrarily close to the origin, for 
which the solution is unbounded and escapes to infinity. A 


Although Theorem 4.11 may not be very helpful as a stability test, we will see 
that it guarantees the existence of a Lyapunov function for the linear system (4.29). 
We saw in Example 4.21 that if we can find ‘a positive definite, bounded matrix 
P(t) that satisfies the differential equation (4.28) for some positive definite Q(t), 
then V(t, £) = 27 P(t)z is a Lyapunov function for the system. If the matrix Q(t) 
is chosen to be bounded in addition to being positive definite, that is, 


0O«csI < Q(t) € cl, Vt>0 


and if A(t) is continuous and bounded, then it can be shown that whien the ori- 
gin is exponentially stable, there is a solution of (4.28) that possesses the desired 
properties. 


Theorem 4.12 Let z = 0 be the exponentially stable equilibrium point of (4.29). 
Suppose A(t) is continuous and bounded. Let Q(t) be a continuous, bounded, positive 
definite, symmetric matriz. Then, there is a continuously differentiable, bounded, 
positive definite, symmetric matriz P(t) that satisfies (4.28). Hence, V(t,z) = 
zT P(t)z is a Lyapunov function for the system that satisfies the conditions of The- 
orem 4.10. o 


Proof: Let 2 
P(t) = f ST (7, t)Q(r)&(r, t) dr 


and $(r;t,z) be the solution of (4.29) that starts at (t, x). 


Due to linearity, 
$(r;t, z) = (7, t)z. In view of the definition of P(t), we have 


aT P(t) = is OT (rit. à) Q(rYó(r:t. a) dr 


t 


nC 
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The use of (4.30) yields 


oo 
zs s [ aoo Melar 
i 
o0 k? def 
« [^ eem ar calls = meld elel 
t 
On the other hand, since 
j lA()la € 5, Vt20 
the solution $(r; t, £) satisfies the lower bouhd?3 
llétr;t z)ll = zie? 279 
‘Hence, 
ic 2 
a? P(t) 2 callé(r; t,x) ||2 dT 
t $ 
o9 c def 
> [oe areal = gie = alel 
t 
Thus 
E ciliz? < 27 P(t)s < call 


which shows that P(t) is positive definite and bounded. The definition of P(t 
shows that it is symmetric and continuously differentiable. The fact that P(t 
satisfies (4.28) can be shown by differentiating P(t) and using the property 


ED = -&(rt)A(0) 
In particular, 
o 8 
Po) = [ woes a 
H Í à Fas J Q(r)8(r.t) dr — Q(t) 
n T 87 (r,t)Q(r)®(z,t) dr A(t) 


t 


-4ro [a (.9909 9 dr - a 
t 
= -P(9A() - A" (OP - Q() 


The fact that V (t, £) = £T P(t)z is a Lyapunov function is shown in Example 4.2 


23See Exercise 3.17. 
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When the linear system (4.29) is time invariant, that is, when A is constant, the 
Lyapunov function V (t, x) of Theorem 4.12 can be chosen to be independent of t. 
Recall that, for linear time-invariant systems, 


Blr, t) = expl(r Dal 


which satisfies (4.30) when A is Hurwitz, Choosing Q to be a positive definite, 
symmetric (constant) matrix, the matrix P(t) is given by 


P= ru exp[(r — t) A7]Q exp|(r — t)4] dr = a exp|AT s|Q exp[As] ds 


which is independent of t. Comparing this expression for P with (4.13) shows that 
P is the unique solution of the Lyapunov equation (4.12). Thus, the Lyapunov 
functiou of Theorem 4.12 reduces to the one we used in Section 4.3. 


The existence of Lyapunov functions for linear systems per Theorem 4.12 will - 


now be used to prove a linearization result that extends Theorem 4.7 to the nonau- 
tonomous case. Consider the nonlinear nonautonomous system 


#= fita) a) 


where f : [0,00) x D — R” is continuously differentiable and D = {z € R” | [zl] < 
r}. Suppose the origin x = 0 is an equilibrium point for the system at t = 0; that 
is, f(t,0) = 0 for all £ > 0. Furthermore, suppose the Jacobian matrix [Df /Ox| is 
bounded and Lipschitz on D, uniformly in t; thus, 


< L|i|[zi -— Zall2, V 21,29 € D, Vt2 0 
2 A 


for all 1 <i € n. By the mean value theorem, 


Of, 
fult,2) = flt,0) + Ëa) s 
where z; is a point on the line segment connecting z to the origin. Since f(t, 0) — 0, 
we can write fi(t,r) as 


fi(t,z) = ela) T= 9 t o) zc page cx PAo) T 
Hence, 
f(t, x) T A(t)z T g(t, x) 
where 
A(t) = A, 0) and 9;(t,2)= [se z)- Seo] T 
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The function g(t, x) satisfies 


n H : 2 1/2 
Ital < (- alt a) - (4,0) ) lilio < Lilei 
i=l 2 


à 


where L = ynL,. Therefore, in a small neighborhood of the origin, we may ap- 
proximate the nonlinear system (4.31) by its linearization about the origin. The 


next theorem states Lyapunov's indirect method for showing exponential stability 
of the origin in the nonautonomous case. 


Theorem 4.13 Let x = 0 be an equilibrium point for the nonlinear system: 
i z fts) i 
where f : [0, o0) x D — R” is continuously differentiable, Dz(s em lla < r), 


md the. Jacobian matriz [Of /Ox] is bounded and Lipschitz. on D; uniformly ín t. 


Ads Ziel 
z=0 


Then, the origin is an ezponentially stable equilibrium point for the nonlinear system 
dit is an exponentially stable equilibrium: point for the’ linear system ^^ 


P= Als 


o 


Proof: : Since the linear system has an exponentially stable equilibrium point ai 
the origin and A(t) is continuous and bounded, Theorem 4.12 ensures the existence 
of a continuously differentiable, bounded, positive definite symmetric matrix P(t) 
that satisfies (4.28), where Q(t) is continuous, positive definite, and symmetric. We 
use V(t, £) zT P(t)z as a Lyapunov function candidate for the nonlinear system. 
The derivative of V(t,z) along the trajectories of the system is given by 


V(tz) = 27 P(t)f(t,2) + f"(t, z)P(t)z + 27 P(t)z 

z7 |P(t)A(t) + AT(t)P(t) + P(t)]z + 227 P(t)g(t, x) 
—aT Q(t)z + 227 P(t)g(t,z) 

—es|zlle + 2eaL|[z |i 

(es — 2ezLp)llzli2, V lle < p 


li 


IA IA Il 


Choosing p < min{r, c3/ (2c2L)} ensures that V (t, z) is negative definite in [zl < p. 
Therefore, all the conditions of Theorem 4.10 are satisfied in |l < p, and we 
conclude that the origin is exponentially stable. B 


P 
i 
H 
H 
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4.7 Converse Theorems 


Theorems 4.9 and 4.10 establish uniform asymptotic stability or exponential sta- 
bility of the origin by requiring the existence of a Lyapunov function V(t,x) that 
satisfies certain conditions. Requiring the existence of an auxiliary function V(t, x) 
that satisfies certain conditions is typical in many theorems of Lyapunov's method. 
The conditions of these theorems cannot be checked directly on the data of the prob- 
lem. Instead, one has to search for the auxiliary function. Faced with this searching 
problem, two questions come to mind. First, is there a function that satisfies the 
conditions of the theorem? Second, how can we search for such a function? In many 
cases, Lyapunov theory provides an affirmative answer to the first question. The 
answer takes the form of a converse Lyapunov theorem, which is the inverse of one 
of Lyapunov's theorems. For example, a-converse theorem for uniform asymptotic 
stability. would confirm that if the origin is uniformly asymptotically stable, then 
there is a Lyapunov function that satisfies the conditions of Theorem 4.9. Most of 
these converse theorems are proven by actually constructing auxiliary functions that 
satisfy the conditions of the respective theorems. Unfortunately, this construction 
almost always assumes the knowledge of the solution of the differential equation. 
Therefore, the theorems do not help in the practica! search for an auxiliary func- 


tion. The mere knowledge that a function exists is, however, better than nothing. ~ 


At least, we know that our search is not hopeless. The theorems are also useful 
in using Lyapunov theory to draw conceptual conclusions about the behavior of 
dynamical systems. Theorem 4.15 is an example of such use. Other examples will 
appear in the following chapters..In this section, we give three converse Lyapunov 
theorems.”4 The first one.is a converse Lyapunov.theorem when the origin is expo- 
nentialy stable and, the second, when it is uniformly asymptotically stable. The 


third theorem applies to autonomous systems and defines the converse Lyapuriov 


function for the whole region of attraction of an asymptotically stable equilibrium 
point. i 

The idea of constructing a converse Lyapunov function is not new to us. We 
have done it for linear systems in the proof of Theorem 4.12. A careful reading 
of that proof shows that linearity of the systein does not play a crucial role in the 
proof, -except for showing that V(t,x) is quadratic in z. This observation leads to 
the first of our three converse theorems, whose proof is a simple extension of the 
proof of Theorem 4.12. l 


"Theorem 4.14 Let 2-0 be:an equilibrium point for the nonlinear system 


"$2 f(t, a) 


where f : (0, o0) X D R" is continuously differentiable, D = {x € R | lzi <r}, 


and the Jacobian matriz (Of /Əx] is bounded on D, uniformly in t. Let k, À, and ro 


See [72] or [107] for a comprehensive treatment of converse Lyapunov theorems and [118] and 


. [10] for more recent results. 
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be positive constants with ro < r/k. Let Do= {x € R” | liz] < ro}. Assume that 
the trajectories of the system satisfy 


liz (£l < kllz(to)le 7 9. V (to) € Do, Vt 2 to 20 


. Then, there is a function V: (0,00) x Do > R that satisfies the inequalities 


cilz V(t.z) < calla? 


OV OVE Lo ud 
2 24 7f(t.z)<- 

Ve 5t Or? (t2) < —esl|izll 
fæle 


iti d c4. Moreover, if r = oo and the origin is 
‘or some positive constants C1, C2, C3, an L RA j 
dul exponentially stable, then V (t, x) is defined and satisfies the aforementioned 


if i V can be chosen 
inequalities on R”. Furthermore, if the system is autonomous, ^ 


_ independent of t. 


Proof Due to the equivalence of norms, it is sufficient to prove the theorem for 
the 2-norm. Let ¢(T; tz) denote the solution of the system that starts at (t, 2); 
that is, o(t;t,2) =z. For all z € Do, ó(7;t, 2) € D for all 7 2 t. Let 
' t+6 
vitse f itai dr 

t 
where ó is a positive constant to be chosen. Due to the exponentially decaying 
bound on the trajectories, we have 


t+5 
n \\o(rst,2)|2 dr 


t6 : k? E 
ve ke?) dr izl = z! ce 2450242 
t 


V(t, z) 


lA 


On the other hand, the Jacobian matrix [8f /Az] is bounded on D. Let 


of 
a» 


<L, VzeD 
2 


" 25 
Then, || f(t, z)lla < Lizz and é(r:t. x) satisfies the lower bound*” 


-2L(r—t 
(rst, ol 2 nelle? 7? 


Hence, 
i 1 -2L6y|.U2 
viz [^ em anl = gg ei 


25See Exercise 3.17. 
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Thus, V(t, £) satisfies the first inequality of the theorem with 


_ pw aks E — e? 
0 = fre and c2 = me 


To calculate the derivative of V along the trajectories of the system, define the 
sensitivity functions 


. a” 
brite) = Solritay: galit a) = glita) 


Then, 


oV +% 


at lE? OT (t+ 6t, 2)ó(t 66,2) — o (tt 2) Olt t,2) 


tô 
«f 297 (r;t, z)ói(rit, x) dr 
t 


t+6 
«f 297 (r; t, z)ós (T;t, x) dr f (tz) 
t 
= je 5tz)é(t 56) - lll 


té 
«f 267 (r;t, z)|di(7; t, 2) + $. (7; t, 2) /(t,)] dr 
t 


It is not difficult to show that?’ 
ét z) + oz(T;t, z) f(t,z)=0, Vr2t 


Therefore, 


ae d 


gatge x oT (t + 5;t, 2) (t + 5t, 2) — lel 


2 -q- eal 
By choosing ô = ln(2k?)/(22), the second inequality of the theorem is satisfied 


with c3 = 1/2. To show the last inequality, let us note that $ (T; t, 2) satisfies the 
sensitivity equation 


È pe = 2, (s d(T; t, x)) bz, Qs (tit, z)- 


Since 
Ie 


eee 


26See Exercise 3.30. 
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on D, à satisfies the bound?" 
lés(r:t, z)lla < e^ 79 
"Therefore, 


ov 
Ox 


tô 
| I 247 (r;t, z)ós(rit,z) dr 
t 


2 2 


: t6 
< I allé(r;t,x)lla lelit, z)lha dr 
I t 
i t+5 
< f 2ke7M7-9 gLi79 dr Well; 
t 


2k 
ye 0-26 
(A = L) [ e lllo 
Thus, the last inequality of the theorem is satisfied with 


| 2k 
; = jt -(A-L)é 
a= Geers TU 


If all the assumptions hold globally, then clearly rg can be chosen arbitrarily large. 
If the system.is autonomous, then (7; t,x) depends only on (T — t); that is, 


é(rit,z) = v(r — tiz) 
Then, 


t6 5 l 
V&s)e f Wr-tawlr-ta)dr= | Yla asa) ds 
t 0 
which is independent of t. : . D 


In Theorem 4.13, we saw that if the linearization of a nonlinear system. about the: 


Theorem 4.15 Let x =0 be an equilibrium point for the nonlinear system 
z= f(t,z) 
where f : {0,00) x D — R” is continuously differentiable, D = {x € R" | |||; <r}, 
and the Jacobian matriz [Df /Ox| is bounded and Eepbonsts on D, uniformly in t. 
Let 
A(t) = EO M 


27See Exercise 3.17. 
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E an exponentially stable equilibrium point for the nonlinear system if 
V exponentially stable equilibrium point for the linear system 


ERAGE 
o 


Proof The "if" part follows from Theorem 4.1 
à í 3. $ u He 
write the linear system as E P 


t= f(t £) — [f(tz) - A(t)z] = f(t,2) — g(t, z) 
Recalling the argument preceding Theorem 4.13, we know that 
le z)la < Liz], Vx eD, vtzo 


Since the origin is an exponentiall ilibri ines 
ne Hally stable equilibrium of the nonlinear s 
are positive constants k, À, and c such that inris 


Iz (lla < klto)lloe 7*9, vi to > 0, v lz(to)llo < € 
Choosing rg < min(c, T/k}, all the conditions of Theorem 4.14 are satisficd. Let 


V(t, x) be the function provided by T i 
13 y Theorem 4.14 and use it as a Ly, 4 i 
candidate for the linear system. Then, DE 


oV oV ôV av av 
ôt T a; Az = OE + 3/6 z) Ex: az bt) 


| € ~elle} + eaLilzi[a 
< -(e-caLp)lzli, Y lizi <p 


The choice p < min{ro, c; /(caL)} ensures that V(t, 2) is negative definite in |z||; < 
P. Consequently, all the conditions of Theoren 4.10 are satisfied in Izlle < o. and 
we conclude that the origin is an exponentially stable equilibrium point for the 
linear system. Qo 


0 be an equilibrium point of the nonlinear ‘system è = 
ously differentiable in some. neighborhood of z = 0. Let 

:15;an. exponentially stable-equilibrium’ point for. the 
of A is. Hurwitz. i . o 


Example 4.23 Consider the first-order system <= —z?, We saw in Example 4,14 
that the origin is asymptotically stable, but linearization about the origin results in 
the linear system t = 0, whose A matrix is not Hurwitz. Using Corollary 4.3, we 
conclude that the origin is not exponentially stable. i A 
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The following converse Lyapunov theorems (Theorem 4.16 and 4.17) extend 
Theorem 4.15 in two different directions, but their proofs are more involved. The- 
orem 4.16 applies to the more general case of uniform asymptotic stability.?? The- 
orem 4.17 applies to autonoinous systems and produces a Lyapunov function that 
is defined on the whole region of attraction. 


Theorem 4.16 Let z — 0 be an equilibrium point for the nonlinear system 
I= F(t.) 


where f : (0,00) x D — R" is continuously differentiable, D = {x € R" | ||z| <r}, 
and the Jacobian matriz [Of /Ox] is bounded on D, uniformly in t. Let B be a class 
KL function and ro be a positive constant such that B(ro,0) < r. Let Do = (x € 
R” | lizi. € ro)- Assume that the trajectory of the system satisfies 


le) S Blz(ta)l.t — to), V z(to) € Do, Vt 2 to 20 


Then, there is a continuously differentiable function V : (0,0) x Do — R that 
satisfies the inequalities 


a(l) S V(t.z) S ox(llzll) 


; | 
z: i x f(&2) € —os(llzl) 


Fe | < lel 


where a1, 02, a3, and o4 are class K functions defined on [0,19]. If the system is 
autonomous, V can be chosen independent of t. o 


Proof: See Appendix C.7. 
"Theorem 4.17 Let z = 0 be an asymptotically stable equilibrium point for the 
nonlinear system 


& = f(z) 
where f : D — R" is locally Lipschitz and D C R" is a domain that contains the 
origin. Let R4 C D be the region of attraction of x = 0. Then, there is a smooth, 
positive definite function V(x) and a continuous, positive definite function W (z), 
both defined for ail x € R4, such that 


V(x) — æ as z ^ ORA 


T f) € -W(x, Vz€RA 
and for any c > 0, (V(z) € c) is a compact subset of Ra. When Ra = R^, V(z) 
is radially unbounded. o 


28Theorem 4.16 can be stated for a function f(t,z) that is only locally Lipschitz, rather than 
continuously differentiable [125, Theorem 14]. It is also possible to state the theorem for the case 
of global uniform asymptotic stability (125, Theorem 23] 
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Proof: See Appendix C.8. 


An interesting feature of Theorem 4.17 is that any bounded subset $ of the 
region of attraction can be included in a compact set of the form (V(z) = cj for 
some constant c > 0. This feature is useful because quite often we have to limit our 
analysis to a positively invariant, compact set of the form (V(z) € c). With m 
property S C {V (z) < c}, our analysis will be valid for the whole set S. If, on the 
other hand, all we know is the existence of a Lyapunov function V; (x) on S, we will 
have to choose a constant c; such that (Vi(z) < ci} is compact and included in 5; 
then our analysis will be limited to (Vi(z) € c1), which is only a subset of S. 


4.8  Boundedness and Ultimate Boundedness 


Lyapunov analysis can be used to show boundedness of the solution of the state 
equation, even when there is no equilibrium point at the origin. To motivate the 
idea, consider the scalar equation 


$--—r-4ósit, z(t2a, a>d>0 


which has no equilibrium points and whose solution is given by 


t 
z(t) 2 ec*7'9)a 46 | ec U7 D sinr dr 
to d 


The solution satisfies the bound 


IA 


© > pt 
jx(t)| e (tog + Ji eg 477) dr = egc(t-t9g$ [2 X etta] 
t . 


0 


^ 


< 4, Vt 2 to 

which shows that the solution is bounded for all ¢ > to, uniformly in to, that is, 
with a bound independent of tp. While this bound is valid for all t > to, it becomes 
a conservative estimate of the solution as time progresses, because it does not take 
into consideration the exponentially decaying term. If, on the other hand, we pick 
any number b such that 6 < b < a, it can be easily seen that 


a— ô 
jx(t)| <b, Vt2 to ln 

b-6 
The bound b, which again is independent of to, gives a better estimate of the solution 
after a transient period has passed. In this case, the solution is said to be uniformly 
ultimately bounded and 5 is called the ultimate bound. Showing that the solution of 
$ = —r-ósint has the uniform boundedness and ultimate boundedness properties 
can be done via Lyapunov analysis without using the explicit solution of the state 
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equation. Starting with V(x) = z?/2, we calculate the derivative of V along the 
trajectories of the system, to obtain 


V = rt = —2? + cósint € —2? + 6|z| 


The right-hand side of the foregoing inequality is not negative definite because, near 
the origin, the positive linear term ó|z| dominates the negative quadratic term —2?. 
However, V is negative outside the set {|z| < 5}. With c > 5?/2, solutions starting 
in the set (V(z) € c) will remain therein for all future time since V is negative 
on the boundary V = c. Hence, the solutions are uniformly bounded. Moreover, 
if we pick any number € such that (82/2) < e < c, then V will be negative in 
the set {e < V < c), which shows that, in this set, V will decrease monotonically 


until the solution enters the set [V < €}. From that time on, the solution cannot 


leave the set (V < £} because V is negative on the boundary V = e. Thus, we 


can conclude that the solution is uniformly ultimately bounded with the ultimate 
bound |z| € 2e. 


The purpose of this section is to show. how Lyapunov analysis can be used to 
draw similar conclusions for the system 
$-—f(t,z) (4.32) 


where f : [0 o0) x D — R” is piecewise continuous in t and locally Lipschitz in z 
on [0, oo) x D, and D C R” is a domain that contains the origin. 


Definition 4.6 The solutions of (4.32). are 


e uniformly bounded if there exists a positive constant c, independent of to > 0, 
and for every a €.(0, c), there is B = 8(à) > 0, indépendent of to, such that 


leloa => llc) SB, Yt to (4.33) 
* globally uniformly bounded if (4.33) holds for arbitrarily large a. 


e uniformly ultimately bounded with ultimate bound b if there exist positive con- 
stants b and c, independent of tg > 0, and for every a € (0,c), there is 
T = T(a,b) > 0, independent of tg, such that 


lelto So = ls <b, vtoto4T (4.34) 


* globally uniformly ultimately bounded if (4.34) holds for arbitrarily large a. 
In the case of autonomous systems, we may drop the word "uniformly" since the 
solution depends only on t — tg. 


To see how Lyapunov analysis can be used to Study boundedness and ultimate 
boundedness, consider a continuously differentiable, positive definite function V(z) 
and suppose that the set {V (x) < c] is compact, for some c > 0. Let 


A — (e € V(z) <c} 
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for some positive constant € < c. Suppose the derivative of V along the trajectories 
of the system ¢ = f (t,x) satisfies 


V(t,z)€-Ws(r) Vee A, Yt to (4.35) 


where W(z) is a continuous positive definite function. Inequality (4.35) implies 
that the sets 2, = {V (x) € c] and Ne = {V (x) < e) are positively invariant since 
on the boundaries ôN. and Ne, the derivative V is negative. A sketch of the sets 
A, Qc, and Q, is shown in Figure 4.8. Since V is negative in A, a trajectory starting 
in A must move in a direction of decreasing V (z(t)). In fact, while in A, V satisfies 
inequalities (4.22) and (4.24) of Theorem 4.9. Therefore, the trajectory behaves as 


if the origin was uniformly asymptotically stable and satisfies an inequality of the 
form J 


llz(t)ll € &(llz(to)ll, t — to) 

: for some class KL function 8. The function V(z(t)) will continue decreasing until 
the trajectory enters the set Qe in finite time and stays therein for all future time. 
The fact that the trajectory enters Ne in finite time can be shown as follows: Let 
k = minzc4 W3(x) > 0. The minimum exists because W3(z) is continuous and A is 
compact. It is positive since Wa(z) is positive definite. Hence, 

Wa(z)-k, Vzr€A (4.36) 

Inequalities (4.35) and (4.36) imply that 


V(tz) &-k, Vr€A Vt2to 
Therefore, 
V(a(t)) € V(z(to)) — k(t — to) € c — k(t — to) 


which shows that V(x(t)) reduces to ¢ within the time interval (to, to + (c — €)/k]. 
In many problems, the inequality V € —1V3 is obtained by using norin inequal- 
ities. In such cases, it is more likely that we arrive at 


Ýt, z) € -Ws(z, Ves lael <r, Yt to (4.37) 
If r is sufficiently larger than p, we can choose c and & such that the set A is 


. nonempty and contained in {x < |[z|| € r). In particular, let a, and ag be class K 
functions such that 29 ' 


ex(llzl) < V(x) < ox(lizl) (4.38) 
From the left inequality of (4.38), we have 
V(z) Se = allel) Se € liell S or'(o) 


29By Lemma 4.3, it is always possible to find such class K functions. 
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Figure 4.8: Representation of the set A, Qe and Qe. 
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Figure 4.9: Representation of the sets Ne, Ne (solid) and By, Br (dashed). 
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"Therefore, taking c = a(r) ensures that Ne C B,. On the other hand, from the 
right inequality of (4.38), we have 


lel <u = V(z) < ex() 


Consequently, taking € — ox; (p) ensures that B, C Ne. To obtain E< > we a 
have i < az! (oa (r)). A sketch of the sets Qe, Qs, By, and B, is shown in rl nee 

The foregoing argument shows that all trajectories starting in Qe ee Wi re 
a finite time T.°° To calculate the ultimate bound on z(t), we use the left inequality 
of (4.38) to write : 


€ 007 


V(z) < e > oa (liz) se €» Well € oF (9) 


CECE 


i — 
30}f the trajectory starts in Qe, T = 0. 
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Recalling that € = oo(u), we see that 
z E Ne = lzel] € o1 (o2 (2) 


Therefore, the ultimate bound can be taken as b = a; ! (oo(u)). 

The ideas just presented for a continuously differentiable function V(x) can be 
extended to a continuously differentiable function V (t, x), as long as V (t, x) satisfies 
inequality (4.38), which leads to the following Lyapunov-like theorem for showing 
uniform boundedness and ultimate boundedness. 


Theorem 4.18 Let D C R” be a domain that contains the origin and V : (0,00) x 
D — R be a continuously differentiable function such that 


ex(llel) < V (5.2) < ollel) / (430) 
V Do fus) € Wala), V lel 2 uo 0 (440) 


V t 2 0 and V x € D, where o4 and az are class K functions and W(x) is a 
continuous positive definite function. Take r > 0 such that B, C D and suppose 


-that — Á— — gd 


pos (441) 


Then, there exists a class KL function B and for every initial state x(to), satisfying 
|x(to)|| < ag*(ai(r)), there is T > 0 (dependent on z(to) and p) such that the 
solution of (4.32) satisfies ; 


Iz (4I < A([|z(to)|],t- 10), VtoStSto- T (4.42) 

lz()) S o1 lau), Vtzto*T . (4.43) 

Moreover, if D = R^ and ay belongs to class Kæ, then (4.42) and (4.43) hold for 
any initial state x(to), with no restriction on how large p is. o 


Proof: See Appendix C.9. 

Inequalities (4.42) and (4.43) show that z(t) is uniformly bounded for all t > 
to and uniformly ultimately bounded with the ultimate bound aj!(aa(u)) The 
ultimate bound is a class K function of p; hence, the smaller the value of u, the 
smaller the ultimate bound. As p — 0, the ultimate bound approaches zero. 

The main application of Theorem 4.18 arises in studying the stability of per- 
turbed systems.?! The next example illustrates the basic idea of that application. 


Example 4.24 In Section 1.2.3, we saw that a mass-spring system with a harden- 
ing spring, linear viscous damping, and a periodic external force can be represented 
by the Duffing's equation 

my + cj + ky + ka?y? = Acoswt 


31 See Section 9.2. 
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Taking zı = y, z2 = y and assuming certain numerical values for the various 
constants, the system is represented by the state model 


ij = 2 
tg = —(1+2})z) — 22+ M cosut 


where M > 0 is proportional to the amplitude of the periodic external force. When 
M = 0, the system has an equilibrium point at the origin. It is shown in Example 4.6 


that the origin is globally asymptotically stable and a Lyapunov function can be 
taken as?? 


n 
L| 
= 
vie 
l- 
Jone 


2 zi 
V (a) z z+2 f (y +y?) dy = a? z+? + iat 
0 


When M > 0, we apply Theorem 4.18 with V(x) as a candidate function. The 
function V(z) is positive definite and radially unbounded; hence, by Lemma 4.3, 
there exist class Kos functions a, and o that satisfy (4.39) globally. The derivative 
of V along the trajectories of the system is given by 


wlio Nile 
ne m 


def 
rjr S zTPr+ ist 
1 


tol 


/ = ~x? — x} — 23 + (zi + 223)M cosut < - |[z|] — 24 + M Vs||z|la 


where we wrote (x; + 212) as y7z and used the inequality y^z < |jællzllyllz2- To 
satisfy (4.40), we want to use part of —||z||2 to dominate M V5||z||; for large ||z||. 
"Towards that end, we rewrite the foregoing inequality as 


V < -Q - 6)lzll — zi — Olz? + M vliz]la 

where 0 < 0 < 1. Then, 
MV5 
V «-0 - jid - zt; Y lel > 15 


which shows that inequality (4.40) is satisfied globally with p = MV/5/0. We 
conclude that the solutions are globally uniformly ultimately bounded. Suppose we 
want to go the extra step of calculating the ultimate bound. In this case, we have 
to find the functions o1 and az. From the inequalities 


V(x) > 27 Pr > Amin(P)l|zli2 


V(z) < a? Pr + žllel2 < Amaz(P)llzll + llel 


32The constants ó and k of Example 4.6 are taken as ô = 2 and k = 1/2. 
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- we see that a; and ag can be taken as 


ar(r) =Amin(P)r? and a(r) = Amaz(P)r? + ir 
Thus, the ultimate bound is given by 


b= az" (as(u)) = XU) = caper ome 


4.9  Input-to-State Stabilit 
Consider the system Lx É 
$ = f(t, z,u). (4.44) 
sd A : p Eri quA i is piecewise continuous in ¢ and locally Lipschitz 
iba d i nC As continuous, MURS function of t for all 


z= f(A) (4.45) 
has a globally uniformly asymptotically stable e 


What can we say about the behavior of the 
bounded input u( 


quilibrium point at the origin z = 0. 


System (4.44) in the presence of 
t)? For the linear time-invariant system j ae 


t = Ar + Bu 


with a Hurwitz matrix A, we can write the solution as 


t 
z(t) = elt) Az (¢9) «f et-DApy(r) dr 


to 


and use the bound |[e*7*)4|| < ke-3-t9 to estimate the solution by 


t 
ROINE ke pato). f ket Blur) dr 
: to 
EVE kl B ` 
S ket- efto BL sup jutr) 
to&r&t 


This estimate shows that the zero-input response decays to zero exponentially fast. 


while the zero-state response is bounded for every bounded input. In fact, the esti- 
eni Shows more than a bounded-input-bounded-state property. It shows that the 
ound on the zero-state response is proportional to the hound on the input, How 


PRRARBADRADAL 
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much of this behavior should we expect for the nonlinear system (4.44)? For a gen- 
eral nonlinear system, it should not be surprising that these properties may not hold 
even when the origin of the unforced system is globally uniformly asymptotically 
stable. Consider, for example, the scalar system 


i = —3r + (1 + 2z?)u 


which has a globally exponentially stable origin when u = 0. Yet, wlen z(0) = 2 
and u(t) = 1, the solution z(t) = (3 — et)/(3 — 2e*) is unbounded; it even has a 
finite escape time. 

Let us view the system (4.44) as a perturbation of the unforced system (4.45). 
Suppose we have a Lyapunov function V(t, x) for the unforced system and let us 
calculate the derivative of V in the presence of u. Due to the boundedness of u, 
it is plausible that in some cases it should be possible to show that V is negative 
outside a ball of radius u, where u depends on sup||u||. This would be expected, 
for example, when the function f(t, x,u) satisfies the Lipschitz condition 


I(t.) = f(62,0) < Ll (446) 


e 


^h^nhnn^o 


Showing that V is negative outside a ball of radius u would enable us to apply 
Theorem 4.18 of the previous section to show that x(t) satisfies (4.42) and (4.43). 
These inequalities show that ||z(t)]| is bounded by a class KL function G(||z(to)||.t— 
to) over [to, tn +7] and by a class K function o !(ao(u)) for t > tg-- T. Consequently, 


lætt) € &liz(to)ll. t — to) + a7 (aa(2)) 


is valid for all t > to, which motivates the next definition of input-to-state stability. 


m. 


Definition 4.7 The system (4.44) is said to be input-to-state stable if there exist a | { \) 
class KL function 8 and a class K function y such that fox any initial state x(to) 
and any bounded input u(t), the solution x(t) exists for all t > to and satisfies 


Iste s Bllatt)|.¢ = to) + (sup Iun) (4.47 


o&T&t 


Inequality (4.47) guarantees that for any bounded input u(t), the state x(t) will be 
bounded. Furthermore, as t increases, the state x(t) will be ultimately bounded by 
a class X function of sup,>,, ||u(t)||. We leave it to the reader (Exercise 4.58) to use 
inequality (4.47) to show that if u(t) converges to zero as t — oo, so does z(t). 
Since, with u(t) =Q, (4.47) reduces to 


llc (9l < ésto) t — to) x 


input-to-state stability implies that the origin of the unforced system (4.45) is glob- 
ally uniformly asymptotically stable. The notion of input-to-state stability is defined 


cce6c0ccccencec 


33 Another interesting use of inequality (4.17) will be given shortly in Lemma 4.7. 
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for the global case where the initial state and the input can be arbitrarily large. A 


logal vagin of this notion ís presented in Exercise 4.60. n. 
The Lyapunov-like theorem that follows gives a sufficient condition for input- 


to-state stability.54 


Theorem 4.19 Let V :|0,00) x R^ — R be a continuously differentiable function . 
such that B 
ea (zl) < V(t, z) S o»(llz) = (4.48) 
See D fima) Wala), V loll > all) >0/ (449 


V (t,2,u) € [0, o0) x R” x R™, where o1, ag are class Koo functions, p is a class 
K function, and W3(z) is a continuous positive definite function on R^. Then, the 
system (4.44) is input-to-state stable with y = o4 o az op. © 
Proof: By applying the global version of Theorem 4.18, we find that the solution 
z(t) exists and satisfies 


Iz Ol S Ali Go) t — to) + (sup TODE vini (450) 
T2lo 


Since z(t) depends only on u(r) for to € T X t, the supremum on the right-hand 
side of (4.50) can be taken over [to, t], which yields (4.47).35  : Dn 


The next lemma is an immediate consequences of the converse Lyapunov theo- 
rem for global exponential stability (Theorem 4.14). i 


Lemma 4.6 Suppose f(t, x,u) is continuously differentiable and globally Lipschitz 
in (x,u), uniformly in t. If the unforced system (4.45) has a globally exponentially 
stable equilibrium point at the origin x = 0, then the system (4.44) is input-to-state 
stable. o 


Proof: View the system (4.44) as a perturbation of the unforced system (4.45). 
(The converse Lyapunov) Theorerg 4.14 shows that the unforced system (4.45) has 
a Lyapunov function V(t,z) that satisfies (4.10) through (4.12) globally. Due to 
the uniform global Lipschitz property of f, the perturbation term satisfies (4.46) 
for all t > tg and all (x, u). The derivative of V with respect to (4.44) satisfies 

\ 


Vox x + ses lts 2,0) + OY (nsu) ~ f(5,2,0)] 


€ ~esllæl? + calel Lull 


34Fox autonomous systems, it is shown in [183] that the conditions of Theorem 4.19 are also 
necessary. In the literature, it is common to abbreviate input-to-state stability as ISS and to call 
the function V of Theorem 4.19 an ISS-Lyapunov function. 

35In particular, repeat the aforementioned argument over the period [0, T] to show that 


liz(e)ll € BIlz(to)l, v — to) + ( Ep a ion) | Vigpgao<T 
t 


oSrS 


Then, set o =T — t. 
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To use the term —es|[z||? to dominate caLl||z||||ul| for large |Iz|, we rewrite the 
foregoing inequality as 


V < -e(1 - 9l? — csl]? + c4Llizllllul 


where 0 < 0 < 1. Then, 


V «-e(1-6)|z]?, Y Jal > Sle 
: c30 


for all (t,z,u). Hence, the conditions of Theorem 4.19 are satisfied with alr) 


2 
c^, œ(r) = c2r?, and p(r) = (c4L €30)r, and we conclude th m i 
- D f] that th t 
input-to-state stable with y(r) = \/c [c1(c4L/c38)r. diio 5 


Lemma 46 requires a globally Lipschitz function f and global exponential sta- 
bility of the origin of the unforced system to conclude input-to-state stability. It is 
easy to construct examples where the lemma does not hold in the absence of one of 


these two conditions. The system ¢ = —3z + (1+ z?)u, which we discussed earlier 


in the section, does not satisfy the global Lipschitz condition. The system 


PS T def 
" i= Tage tu fleu) 


has a globally Lipschitz f since the partial derivatives of f with respect to x and 
u are globally bounded. The origin of 4 = —2/(1+ z?) is globally asymptoticall 
stable, as it can be seen by the Lyapunov function V(z) = z?/2, whose derivative 
V(z) = —x?/(1 + z?) is négative definite for all x. It is locally exponentially stable 
because the linearization at the origin ist = —z. However, it is not global 
exponentially stable. This is easiest seen through the fact that the systein is i 
Input-to-state stable. Notice that with u(t) = 1, f(z,u) > 1/2. Hence z(t) > 
(to) + t/2 for all t > 0, which shows that the solution is unbounded, ~ 
In the absence of global exponential stability or globally Lipschitz functions, we 
may still be able to show input-to-state stability by applying Theorem 4.19 This 
Process is illustrated by the three examples that follow. _ 


Example 4.25 The system 
$-—zx3544 
has a globally asymptotically stable origi i 
ag y st gin when u = 0. Taking V = 72/2, t 
derivative of V along the trajectories of the system is given by ; ie 


V — -2'+ou=~(1~6)2* — r5 +2u<-(1~4)24, V |z| > (5) r 
2 


where 0 < 0 < 1. Thus, the system is input-to-state stable with y(r) = (r/0)1/8. 
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Example 4.26 The system 
i= f(a,u) = ~z — 223 + (14-27)u? 


has a globally exponentially stable origin when u = 0, but Lemma 4.6 does not 
apply since f is not globally Lipschitz. Taking V = z?/2, we obtain 


7 = =r? — 23^ + a(14+27)u? < -24, V |z] > v? 
Thus, the system is input-to-state stable with y(r) = r?. a 


In Examples 4.25 and 4.26, the function V(x) = z?/2 satisfies (4.48) with 
a(r) = ax(r) = r?/2. Hence, aj!(az(r)) = r and 4(r) reduces to p(r). In 
higher-dimensional systems, the calculation of + is more involved. 


Example 4.27 Consider the system 
dj = -r +a? 
i2 = -r2+u 


We start by setting u = 0 and investigate global asymptotic stability of the origin 
of the unforced system. Using 


V(x) = 427 + laz, a>0 
as a Lyapunov function candidate, we obtain 
4 


y 42 
V = —a} + 2123 — ax} = -(n- $23)’ — (a — $) 22 


Choosing a > 1/4 shows that the origin is globally asymptotically stable. Now we 
allow u # 0 and use V(x) with a = 1 as a candidate function for Theorem 4.19. 
The derivative V is given by 


V = -i( — 05)? - d(0i 22) + gu < 3 (27 + 22) + Ims" 
To use the term —(x? + z1)/2 to dominate [zo|?|u|, we rewrite the foregoing in- 
equality as 
V € -à(1 — 8) (zi 22) — 36 (21 + 2) + Ir? lu] 
where 0 « 0 « 1. The term 
-i6(zi 22) + [æa Flu 


will be < 0 if |za| > 2|u|/0 or |za| < 2|u|/0 and |zi| > (2|u|/0)?. This condition is 


implied by 
2|u| (2]ul V" 
max(|zi|, lol) 2 max 1 757 (n ) 
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Using the norm ||z||5, = max{|z,|, |z2]) and defining the class K function p by 


plr) = max E (5 


we see that inequality (4.49) is satisfied as 
V«-iü0-0)(ib:2) Viele 2 olu) — 


Inequality (4.48) follows froin Lemma 4.3 since V(z) is positive definite and radially 
unbounded. Hence, the system is input-to-state stable. Suppose we want to find 
the class K function y. In this case, we need to find a and ag. It is not hard to 
see that l 
V(x) = $2} + 52 < dall + aliel 
ie = jl. if [za] < [eil 
V(z) = izle iz 
ileal = illello» if |za| 2 |z1| 
Inequality (4.48) is satisfied with the class Koo functions 
ai(r) &inin[1r2.15]) and a2(r) = hr? + iy 


Thus, y(r) = aj (oa(o(r))). where 


n 

E (4s)4, ifs<1 
o (s) = 

vs, ifs>1 


The function y depends on the choice of ||z||. Had we chosen another p-norin, we 
could have ended up with a different y. A 
. An interesting application of the concept of input-to-state stability arises in the 
stability analysis of the cascade system 
& = filt, £1, T2) e (4.51) 
t2 = falt, x2) (4.52) 


where fi : (0,00) x R™ x R™ — R^ and fa : (0,00) x R™ — R”? are piecewise 


continuous in £ and locally Lipschitz in z = ss . Suppose both 


#1 = i(t,21,0) 


and (4.52) have globally uniformly asymptotically stable equilibrium points at their 
respective origins. Under what condition will the origin z = 0 of the cascade 
system possess the same property? The next lemma shows that this will be the 
case if (4.51). with x2 viewed as input. is input-to-state stable. 
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i if the system (4.51), with z as input, 

a 4.7 Under the stated assumptions, if t i r 
ERA stable and the origin of (4.52) is globally ately deyme a 
stable, then the origin of the cascade system (4.51) and (4.52) is globally y 


asymptotically stable. 
Proof: Let to 2 0 be the initial time. The solutions of (4.51) and (4.52) satisfy 


^ 


"ERCOOEDCXOMMO 
leal < Gellel =s) (4.80) 


globally. "where t > s > to, £1, G2 are class KL functions and 7; is a class K function. 
J1 a = ʻ : 
Apply (4.53) with s — (t + to)/2 to obtain 


zi (‘4*)| 5)» Cem.) | (4.55) | 


To estimate z1 ((£ + to)/2), apply (4.53) with s = to and t replaced by (t + t9)/2 to 


obtain 
t+to 
Zi 2 


Using (4.54), we obtain 


ACTES ( 


« (Ie tot, 5) + — i (4.50) 


sup lizat) < Ballla(to)l,0) (4.57) 
torso 

sup dat s Ba (Itn t) (4.58) 
x xl 


Substituting (4.56) through (4.58) into (4.55) and using the inequalities 
liza(to) || € lizol lla (to)1] < lito) lx) < Wes COT ina COT 


i lætt) < B(\2(to)ll, t — to) 


where 
air, s) = Bs (& (2) +n 6909.5) m (& (n3) +A) 


It can be easily verified that B is a class ICL function for all r > 0. Hence, the oen 
of (4.51) and (4.52) is globally uniformly asymptotically stable. 
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4.10 Exercises 


4.1 Consider a second-order autonomous system. For each of the following types 
of equilibrium points, classify whether the equilibrium point is stable, unstable, or 
asymptotically stable: 

(1) stable node (2) unstable node — (3) stable focus 

(4) unstable focus (5) center (8) saddle 
Justify your answer using phase portraits. 


4.2 Consider the scalar system t = az? + g(x), where p is a positive integer and 
g(x) satisfies |g(z)| < k|z[P*! in some neighborhood of the origin x = 0. Show that 
the origin is asymptotically stable if p is odd and a < 0. Show that it is unstable if 
p is odd and a > 0 or p is even and a #0. 


4.3 For each of the following systems, use a quadratic Lyapunov function candidate 
to show that the origin is asymptotically stable: 


(1) ti = —2£ 4m, $9 = -r2 

(2) a = >r- t(l- z? ~ 23), fo = 2, ~22(1-2? — 23) 
(3) h = 22(1—2%), i9 = —(x,+22)(1— x?) 
(4) a = -n-z£ tg = I-23 


Investigate whether the origin is globally asymptotically stable. 


4.4 ([151]) Euler equations for a rotating rigid spacecraft are given by 


Jy, = (Jo — Jg)waws + ui 
Jwz. = (Jz — Jy )wgw, + u2 
Jwg = (J; - Jz )wiwe + us 


where w; to ws are the components of the angular velocity vector w along the 
principal axes, u, to ug are the torque inputs applied about the principal axes, and 
Jı to J3 are the principal moments of inertia. 


(a) Show that with u; = u2 = ug = 0 the origin w = 0 is stable. Is it asymptotically 
stable? 


(b) Suppose the torque inputs apply the feedback control u; = —k;w;, where kı to 
ks are positive constants. Show that the-origin of the closed-loop system is 
globally asymptotically stable. 


4.5 Let g(x) be a map from R” into R”. Show that g(x) is the gradient vector of 
a scalar function V : R” — R if and only if 


09: = 09; 
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4.6 Consider the system 


d = T3, i: = -(zi 4-22) - A(z, + x2) 


where h is continuously differentiable and zh(z) > 0 for all z € R. Using the 


variable gradient method, find a L i 
yapunov function that sh th igin i 
globally asymptotically stable. eee cd 


4.7 Consider the system ¢ = -Qé(z) where Q is à i iti 
; | i symmetric positive definite 
matrix and $(z) is a continuously differentiable function for which the ith a 
nent ¢; depends only on zi, that is, ¢;(x) = ¢i(z;). Assume that ġ:(0) = 0 and 
yéi(y) > 0 in some neighborhood of y — 0, for all 1 Sign 


(a) Using the variable gradient method, find a Lyapunov function that shows that 
the origin is asymptotically stable. 


(b) Under what conditions will it be globally asymptotically stable? 
(c) Apply to the case 


n= 2, 91(t1) = 21 — 23, $2(r2) = 22 +23, Q = | i | 
4.8 ([72]) Consider the second-order system 


. —62, é 
Ti Tad + 2z2, fo = 


where u = 1+ 2}. Let V(x) = z2/(1-- 22) + z2, 
(a) Show that V(z) > 0 and V(x) « 0 for all z € R2 — {0}. 


(b) d the hyperbola z, = 2/(z1 — V2). Show, by investigating the vector 
eld on the boundary of this hyperbola, that trajectories to the right of the 
branch in the first quadrant cannot cross that branch. 


(c) Show that the origin is not globally asymptotically stable. 


Hint: In part (b), show that 22/2, = ~1/(1+2V/2z 1 i 
é A = 1 221) on the hyperbola, 
compare with the slope of the tangents to the hyperbola. X eee 


4.9 In checking radial unboundedness of a positive definite function V (a), it may 
appear that it is sufficient to examine V(z) as ||z|| — oo along the principal axes. 
This is not true, as shown by the function 


V(x) = itr)’ | t 22)? 


1- (zi + zy T (zi m x2)" 
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(a) Show that V(x) — oo as ||z|| — oo along the lines x = 0 or z3 = 0. 
(b) Show that V(z) is not radially unbounded. 


4.10 (Krasovskii's Method) Consider the system ¢ = f(x) with f(0) = 0. 
Assume that f(z) is continuously differentiable and its Jacobian [Of /Óx] satisfies 


af Ohl’ " dE 
P [Ew] + [2h] P<-I, Vz€R", whereP=P* >0 


(a) Using the representation f(z) = 2. 9 (ox)z dc, show that 
z"Pf(z)-f'(z)Pr < Tm, Vx € R^ 


(b) Show that V(r) = fT (z)P f(x) is positive definite for all z € R” and radially 
unbounded. 


(c) Show that the origin is globally asymptotically stable. 


4.11 Using Theorem 4.3, prove Lyapunov's first instability theorem: 

For the system (4.1), if a continuously differentiable function Vi(z) can be found 
in a neighborhood of the origin such that Vi (0) = 0, and V, along the trajectories 
of the system is positive definite, but Vi itself is not negative definite or negative 
seinidefihite arbitrarily near the origin, then the origin is unstable. 


4.12 Using Theorem 4.3, prove Lyapunov's second instability theorem: 

For the system (4.1), if in a neighborhood D of the origin, a continuously differ- 
eutiable function Vi (x) exists such that V; (0) = 0 and V, along the trajectories of 
the systein is of the form Y = AV; + W (x) where A > 0 and W(x) > 0 in D, and 
if V (z) is not negative definite or negative semidefinite arbitrarily near the origin, 
then the origin is unstable. 


4.13 For each of the following systems, show that the origin is unstable: 


(1); a) = zl-czix; t = -r++ rir- r? 
(2) 454 = -dübtza t = af-23 


Hint: In part (2), show that T = (0 < zi € 1)n {z2 > z]) n {z2 € 22) isa 

nonempty positively invariant set, and investigate the behavior of the trajectories 

inside T. : 

4.14 Consider the system 
$j—322, —2--g(zi)zi- 12) 


where g is locally Lipschitz and g(y) > 1 for all y € R. Verify that V(x) = 
o^ yg(y) dy + z122 + z3 is positive definite for all z € R? and radially unbounded, 


and use it to show that the equilibrium point z = 0 is globally asymptotically stable. . 


à 


PO AR ORADAAADARAAAAABAARARA, 


` 


v 


POCE 


S 
À 


406 006060060000 


N 
P 


vet Mem 
SA 


ae 


Y 


y: 


nes 


AMAR 


B 


"Eo e et Vv EO 


€999997909099999 979 9 9. 0 9 0. 99 9.94 


" : : ; 3 $i 


184 CHAPTER 4, LYAPUNOV STABILITY 


4.15 Consider the system 
dj. — $2 —hi(zi)- T2 — ho(zs) t3 = 12 — za 


where hı and hg are locally Lipschitz functions that satisfy h;(0) = 0 and yhi(y) > 0 
for all y 4 0. 


(a) Show that the system has a unique equilibrium point at the origin. 


(b) Show that V(x) = Ph hi(y) dy + 22/2 + jJ ho(y) dy is positive definite for 
all z € R3. 


(c) Show that the origin is asymptotically stable. 


(d) Under what conditions on h; and he, can you show that the origin is globally 
asymptotically stable? 


4.16 Show that the origin of 


is globally asymptotically stable. 
4.17 ([77]) Consider Liénard's equation 

i + h(y)y + g(y) - 0 
where g and h are continuously differentiable. 


(a) Using zı = y and z2 = j, write the state equation and find conditions on g 
and A to ensure that the origin is an isolated. equilibrium point. 


(b) Using V(z) = bn g(y) dy + (1/2)z2 as a Lyapunov function ned find 
conditions on g and h to ensure that the origin is asymptotically stable. 


(c) Repeat part (b) using V(x) = (1/2) [z2 + fo" hly) dy)” + fo’ gly) dy. 
4,18 The mass-spring system of Exercise 1.12 is modeled by 

My = Mg — ky ~ cid — coyly| 
Show that the system has a globally asymptotically stable equilibrium point. 


4.19 Consider the equations of motion of an m-link robot, described in Exer- 
cise 1.4. Assume that P(q) is a positive definite function of q and g(q) = 0 has an 
isolated roots at g = 0. 


(a) With u = 0, use the total energy V(gq,d) = 14^ M (q)¢+ P(q) as a Lyapunov 
function candidate to show that the origin (q = 0, d = 0) is stable. 


|æ (ER n eer . 
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(b) With u = —K44, where Ky is a positive diagonal matrix, show that the origin 
is asymptotically stable. 


(c) With u = g(q) — K,(q — q*) — Kaġ, where Kp and Ka are positive diagonal 
matrices and q* is a desired robot position in F^, show that the point (q = 
q", d = 0) is an asymptotically stable equilibrium point. 


4.20 Suppose the set M in LaSalle's theorem consists of a finite number of isolated 
points. Show that lim,.., z(t) exists and equals one of these points. 


4.21 ([81]) A gradient system is a dynamical system of the form $ = -VV (a), 
where VV (z) = [BV/Oz]T and V : D C R^ — R is twice continuously differentiable, 


(a) Show that V(z) < 0 for all z € D, and V(z) = 0 if and only if z is an 
equilibrium point. 

(b) Suppose the set N. = (ze R" | V(x) < c} is compact for every c € R. Show 
that every solution of the system is defined for all t > 0. 


(c) Continuing with part (b), suppose VV(z) x 0, except for a finite number of 


points p1,...,p,. Show that for every solution z(t), limpoo x(t) exists and 
equals one of the points pi,... , pr. 


4.22 Consider the Lyapunov equation PA+ AT P = 
is observable. Show that A is Hurwitz if and only 
that satisfles the equation. Furthermore, 

equation will have a unique solution. 
Hint: Apply LaSalle's theorem and recall tha 
vector C exp(At)z = 0 V t if and only if z = 0. 


—CTC, where the pair (A,C) 
if there exists P = PT > 0- 
show that if A is Hurwitz, the Lyapunov 


t for an observable pair (A,C), the 


4.23 Consider the linear system ¢ = (A — BR^BTP)z, where P = PT > 0. 
satisfies the Riccati equation 


PA+A™P+Q~PBR™BTP =9 


R = R? > 0, and Q = QT > 0. Using V(x) = x 
candidate, show that the origin is globally asymptoti 


(1) Q» 0. 


TPz as a Lyapunov function 
cally stable when 


(2) Q — C"C and (A, C) is observable; see the hint of Exercise 4.22. 
4.24 Consider the system? 


T 
è = f(z) - kG(z) R7 (z)G7 (2) (5) 


36This is a closed-loop system under optimal stabilizing control. See [172]. 
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where V(z) is a continuously differentiable, positive definite function that satisfies 
the Hamilton-Jacobi-Bellman equation 


oV P 
ae M2) «2 - iga (27). =o 


g(z) is a positive semidefinite function, R(z) is a nonsingular matrix, and k is a 
positive constant. Using V(z) as a Lyapunov function candidate, show that the 
origin is asymptotically stable when 

(1) a(z) is positive definite and k > 1/4. 


(2) a(z) is positive semidefinite, k > 1/4, and the only solution of $ = f(z) that 
can stay identically in the set (q(z) = 0) is the trivial solution x(t) = 0. 


When will the origin be globally asymptotically stable? 


4.25 Consider the linear system ¢ = Az + Bu, where (A, B) is controllable. Let 
W = fy e~4*BBTe-A"* dt for some T > 0. Show that W is positive definite and 
let K = BTW-, Use V(z) = zTW-!z as a Lyapunov function candidate for the 
system t = (A — BK)z to show that (A — BK) is Hurwitz. 


4.26 Let i = f(x), where f : R” — R^". Consider the change of variables z = 
T(z), where T(0) = 0 and T : R” — R” is a diffeomorphism in the neighborhood 
of the origin; that is, the inverse map T'7! (-) exists, and both T(-) and T-!(.) are 
continuously differentiable. The transformed system is 


z= f(z), where f(z) = 2T hla) 
z=T~-1(z) 


(a) Show that z = 0 is an isolated equilibrium point of ¢ = f(x) if and only if 
z = 0 is an isolated equilibrium point of z = f(z). 


(b) Show that z = 0 is stable (asymptotically stable or unstable) if and only if 
z = 0 is stable (asymptotically stable or unstable). 
4.27 Consider the system 
$i = -T223 +l, d2=2,73-22, £3 = 23(1 — z3) 
(a) Show that the system has a unique equilibrium point. 


(b) Using linearization, show that the equilibrium point asymptotically stable. Is 
it globally asymptotically stable? 


4.28 Consider the system 


$i-2-—z t = (z122 = 1)x3 + (x1 22 -1 + 22)3 


4.10. EXERCISES 187 


(a) Show that x = 0 is the unique equilibrium point. 
(b) Show, by using linearization, that « = 0 is asymptotically stable. 
(c) Show that T = {x € R? | ziz2 > 2} is a positively invariant set. 
(d) Is z = 0 globally asymptotically stable? 
4.29 Consider the system 

i= ri a] +r t2 = 31 — z2 
(a) Find all equilibrium point of the system. 
(b) Using linearization, study the stability of each equilibrium point. 


(c) Using quadratic Lyapunov functions. estimate the region of attraction of each 
asymptotically stable equilibrium point. Try to make your estimate as large 
as possible. 


(d) Construct the phase portrait of the system and show on it the exact regions of 
attraction as well as your estimates. 
4.30 Repeat the previous exercise for tlie system 
; 1 TU; ; 
ij--—35 tan (=) + a, 


4.31 For each of the systems of Exercise 4.3, use linearization to show that the 
origin is asymptotically stable. 


. 1 TX2 
tg =2,—- 3tan oC 


4.32 For each for the following systenis. investigate whether tlie origin is stable, 
asymptotically stable, or unstable: 


by = noc A E ee 23 — sat(y)]? 
TN MER (2) i; = -sinza + x[-273 — sat(y 
; 5 $4 = —2z3 —sat(y) 
T3 = 3-2] where y = —22, — 5x2 + 223 
ij = 22, +2} tj) = —Xi 
(3) £9 = —a2+2? (4) i9 = -T -— T2 — T3 — 2123 
nere, ds = (mol) 


4.33 Consider the second-order system i = f(x), where f(0) = 0 and f(z) is 
twice continuously differentiable in some neighborhood of the origin. Suppose 
[8f/0z)(0) = —B, where B be Hurwitz. Let P be the positive definite solution 


.of the Lyapunov equation PB + BTP = —I and take V(r) = zT Pz. Show that 


there exists c* > 0 such that, for every 0 < c < c", the surface V(x) = c is closed 
and [@V/dz|f(z) > 0 for all z € {V (z) = c). 
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4.34 Prove Lemma 4.2. | 
4.35 Let a be a class K function on [0, a). Show that 


a(ri +12) S a(2) + a(2ra), Vrir2€ (0,2) 


4.36 Is the origin of the scalar system z= —r/(t+ 1), t 29, uniformly asymp- 
totically stable? 


4.37 For each of the following linear systems, use a quadratic Lyapunov function 
to show that the origin is exponentially stable: 
| -1 a(t) | " 
-a(t) -2 


i 20 le asl (å 
[o h 


a(t) 
4.38 ([95]) An RLC circuit with time-varying elements is represented by 


to = a — R(t) 
=" Ce" LQ) 
Suppose that L(t), C(t), and R(t) are continuously differentiable and satisfy the 


inequalities ky € L(t) € k2, ka € C(t) < k4, and ks < R(t) < ke for all t > 0, where 
kı, kg, and ks are positive. Consider a Lyapunov function candidate 


L 2 
viz) - [n0 xd | tenet gg 


(1) ¢ 


i 
H 


li 


1 2 
(3) ¢ = | S ES a22 Ut 


In all cases, a(t) is continuous and bounded for all t > 0. 


T 
T2, 2 
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(a) Show that V(t, x) is positive definite and decrescent. 


(b) Find conditions on BOC. a and R(t) that will ensure exponential stability 
of the origin. 


4.89 ([154]) A pendulum with time-varying friction is represented by 
y= rp #2 =—sinz, — g(t)za 
Suppose that g(t) is continuously differentiable and satisfies 
0cacoxg(t) &8«oo and glt)<7<2 
for all t > 0. Consider the Lyapunov function candidate 


V(t,z) = l(asinzi + x9)? + [1 + ag(t) — a?|(1— cos) 
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(a) Show that V(t, x) is positive definite and decrescent. 


(b) Show that V < —(a —a)z2 — a(2 — 3)(1 - cos z1)  O([|zi[3), where O(||z\|*) is 
a term bounded by k|[z||? in some neighborhood of the origin. 


(c) Show that the origin is uniformly asymptotically stable. 


4.40 (Floquet theory) Consider the linear system ¢ = A(t)z, where A(t) = 
A(t 4- T).3" Let ®(-,-) be the state transition matrix. Define a constant matrix B 
_via the equation exp(BTT) = &(T, 0), and let P(t) = exp(Bt)9(0, t). Show that 


(a) P(t t T) = P(t). 

(b) ®(t,7) = P7! (t) exp[(t - 7) B]P(7). 

(c) the origin of ¢ = A(t)z is exponentially stable if and only if B is Hurwitz. 

4.41 Consider the system 

ij 2, Lo = 2x, rq + 3t +2 — 3zi — 2(t + 1)z2 
(a) Verify that z(t) = t, z2(t) = 1 is a solution. 
(b) Show that if z(0) is sufficiently close to | " | then z(t) approaches | : | as 
t oo. 
4.42 Consider the system 
' è= afla + S(z) + zxT]z 

where a is a positive constant, J, is the n x n identity matrix, and S(x) is an z- 


dependent skew symmetric matrix. Show that the origin is globally exponentially 
stable. 


4.43 Consider the system t = f(x)+G(x)u. Suppose there exist a positive definite 


symmetric matrix P, a positive semidefinite function IV (zx), and positive constants 
^; and ø such that 


227 Pf (z) - 43237 Px + W(x) — 201" PG(z)GT(z)Px <0, VzeR" 


Show that with u = —oG? (z)Pz the closed-loop system has a globally exponentially 
stable equilibrium point at the origin. 


4.44 Consider the system 
ti = —rid xac (2? +z2)sint, t2 = ~r; — r2 +(x? +23) cost 


Show that the origin is exponentially stable and estimate the region of attraction. 


37See [158] for a comprehensive treatment of Floquet theory. 
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4.45 Consider the system 
tı = h(t)z2 -g(t)rj ^ i2- h(t)jm — g(t) x} 


where h(t) and g(t) are bounded, continuously differentiable functions and g(t) > 
k > 0, for all t > 0. : 


(a) Is the equilibrium point z = 0 uniformly asymptotically stable? 
(b) Is it exponentially stable? 
(c) Is it globally uniformly asymptotically stable? 
(d) Is it globally exponentially stable? 
4.46 Show that the origin of the system 
ij--2;—-z1(1—-22—-32), i= ay — 2(1 — 2? — 23) 

is asymptotically stable. Is it exponentially stable? 
4.47 Consider the system 

tı = —ó(t)ri +ad(t)z2, £2 = bó(t)z, — abd(t)z2 — ep(t)x} 


where a, b, and c are positive constants and $(t) and Y(t) are nonnegative, contin- 
uous, bounded functions that satisfy 


g(t) 2 do > 0, W(t) > yo > 0, Vt20 


Show that the origin is globally uniformly asymptotically stable. Is it exponentially 
stable? 


4.48 Consider two systems represented by $ = f(x) and $ = h(x)f(z) where 
f: R^ — R" and h : R” — R are continuously differentiable, f(0) = 0, and 
h(0) » 0. Show that the origin of the first system is exponentially stable if and only 
if the origin of the second system is exponentially stable. 


4.49 Show that the system 

di = ~az; +b, t = —CT2 + zila - Bz123) 
where all coefficients are positive, has a globally exponentially stable equilibrium 
point. 


Hint: Shift the equilibrium point to the origin and use V of the form V = k, Yf + 
kay? + kayt, where (y1, y2) are the new coordinates. 
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4.50 Consider the systein 
f£-f(try f(t0)20 
where [8f /Az] is bounded and Lipschitz in z in a neighborhood of the origin, uni- 
formly in t for all t > to > 0. Suppose that the origin of the linearization at z = 0 
is exponentially stable. and the solutions of the system satisfy 
lell € &liz(to)l.t— to). Vt2to20, Y lelto) «c (4.59) 
for some class KL function J and soine positive constant c. 


(a) Show that there is a class X function a and a positive constant y such that 


liz(£)ll € e(liz(to)l) exp[-r(t — to), Yt2 to, Y llz(to)l| «c 


(b) Show that there is a positive constant M, possibly dependent on c, such that 


lll € Mlle(to)l| exp[-v(t - to), Vt2to, Vllz(to) «c (460) 


(c) If inequality (4.59) holds globally. can you state inequality (4.60) globally? 


4.51 Suppose the assumptions of Theorem 4.18 are satisfied with o1(r) = kir?^,. 
a(r) = kgr*, and W(x) > ka|lzl|^. for some positive constants ky, ke, k3, and a. 
Show that (4.42) and (4.43) are satisfied with G(r, s) = kr exp(—7s) and ay (az(u)) 
ku, where k = (ka/k1)!/* and y = kg/(k2a). 


4.52 Consider Theorem 4.18 when V(t, x) = V(x) and suppose inequality (4.40) 


is replaced by dé 


gT (69) € -Wa(z) VWé(z)2520 

z 

for some continuous positive definite functions W3 (x) and W4(x). Show that (4.42) 
and (4.43) hold for every initial state z(to) € {V (£) € c) C D. provided {V (x) < c} 
is compact and maxw,(z)«, V (£) < c. 


4.53 ([72]) Consider the system 2 = f(t, x) and suppose there is a function V (t, z) 
that satisfies . 
Wi(z) < V(t,z) < We(z), V lel 27 >0 


ov Da) <0, vizi 227 


where Wi(z) and Wa(z) are continuous, positive definite functions. Show that the 
solutions of the system are uniformly bounded. 
Hint: Notice that V(t.z) is not necessarily positive definite. 
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4.54 For each of the following scalar systems, investigate input-to-state stability: 


(1) ż=-(1 +u)? (2). ¢ = -(1 + u)r? — 2° 


(3) £9 -z-42?u (4 $-z-25*u 


4.55 For each of the following systems, investigate input-to-state stability: 


(1) di = —2, +2422, i = -r3 —r2+u 
(2) dj = —@ +22, fp = -r-r +u 
(3. / £& = 22, dj = ~ai-—a2+4 
(4) di = (a, -—22+)(2} - 1), 49 = (a, +22 +u)(x} - 1) 
(5) di = -r riz fo = r+ +u 
(6) a = —2i1— 220 $9 = mz - aj X us 
(7) `å = -ntz ża = -zi-o(z))-2z2-0u 


where c is a locally Lipschitz function, o(0) = 0, and yc(y) 2 0 for all y # 0. 
4.56 Using Lemma 4.7, show that the origin of the system 

dj -r + m, i9 = -r3 
is globally asymptotically stable. 


4.57 Prove another version of Theorem 4.19, where all the assumptions are the 
same except that inequality (4.49) is replaced by 


oy d u f(t, x,u) < —ox(lizll) + (v) 


where a3 is a class Koo function and y(u) is a continuous function of u with (0) = 0. 


4.58 Use inequality (4.47) to show that if u(t) converges to zero as t — 00, so does 
x(t). : 
4.59 Consider the scalar system è = —x3 +e~'. Show that z(t) — 0 ast — oo. 


° > e the assumptions of Theorem 4.19 are satisfied for ||zl|| < r and 
lm 


< rą with class K functions o; and az that are not necessarily class Koo. Show 
that there exist positive constants k; and kz such that inequality (4.47) is satisfied 
for ||z(to)| < kı and supiz,, lle(t)ll < Az. In this case, the system is said to be 
locally input-to-state stable. RI 
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4.61 Consider the system 


t=T ([ (B-a, t = -T2 + U 


(a) With u = 0, show that the origin is globally asymptotically stable. 
(b) Show that for any bounded input u(t), the state z(t) is bounded. 


(c) With u(t) = 1, z1(0) = a, and x9(0) = 1, show that the solution is z;(t) = a, 
T2 (t) =1. 


(d) Is the system input-to-state stable? 


In the next seven exercises, we deal with the discrete-time dynamical system?? 


z(k-1)- f(z(k), f(0) =0 (4.61) 


The rate of change of a scalar function V(x) along the motion of (4.61) is defined 
by i 
AV(z)  V(f(z)) - V(z) 


4.62 Restate Definition 4.1 for the origin of the discrete-time system (4.61). 


4.63 Show that the origin of (4.61) is stable if, in a neighborhood of the origin, 
there is a continuous positive definite function V(z) so that AV(z) is negative 
semidefinite. Show that it is asymptotically stable if, in addition, AV (z) is nega- 
tive definite. Finally, show that the origin is globally asymptotically stable if the 
conditions for asymptotic stability hold globally and V (z) is radially unbounded. 


4.64 Show that the origin of (4.61) is exponentially stable if, in a neighborhood 
of the origin, there is a continuous positive definite function V(x) such that 


elsi? < V(z) < clle’, ^— AV(z) < —esllzl 


for some positive constants c, co, and C3. 
Hint: For discrete-time systems, exponential stability is defined by the inequality 
llz(&)|| € o]z(0) ^ for all k > 0, where a > 1 and 0 < 7 < I. 


4.65 Show that the origin of (4.61) is asymptotically stable if, in a neighborhood 
of the origin, there is a continuous positive definite function V(x) so that AV(z) is 
negative semidefinite and AV (x) does not vanish identically for any z # 0. 


4.66 Consider the linear system x(k +1) = Ax(k). Show that the following state- 
ments are equivalent: 


38See [95] for a detailed treatment of Lyapunov stability for discrete-time dynamical systems. 
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(1) x =0 is asymptotically stable. 
(2) Dil < 1 for all eigenvalues of A. 


(3) Given any Q = QT > 0, there exists P = PT > 0, which is the unique solution 
of the linear equation AT PA — P = ~Q. 


4.67 Let A be the linearization of (4.61) at the origin; that is, A = [8f /Oz](0). 


` Show that the origin is asymptotically stable if all the eigenvalues of A have mag- 


nitudes less than one. 
4.68 Let r = 0 be an equilibrium point for the nonlinear discrete-time system 
z(k +1) = f(z(k)), where f : D — R” is continuously differentiable and D = {z € 
R^ | ||zl| < r}. Let C, y < 1, and ro be positive constants with ro < r/C. Let 
Do = {x € R” | ||z|| < ro). Assume that the solutions of the system satisfy 
llæ(k)|| < Clls(o)]o*, V z(0) € Do, Yk 20 
Show that there is a function V : Dg — R that satisfies 
calle]? < V() < calle|? 

AV(z) = V(f(z)) - V(x) € —callzl" 

IV(z) - V(y)| < calle — vll zll + lly) 
for all z, y € Do for some positive constants c1, co, c3, and c4. 


Chapter 5 


Input-Output Stability 


In most of this book, we use the state-space approach to model nonlinear dynamical 
systems and place a lot of emphasis on the behavior of the state variables. An 
alternative approach to the mathematical modeling of dynamical systems is the 
input-output approach.! An input-output model relates the output of the system 
directly to the input, with no knowledge of the internal structure that is represented 
by the state equation. The system is viewed as a black box that can be accessed only 
through its input and output terminals. In Section 5.1, we introduce input-output 


. mathematical models and define £ stability, a concept of stability in the input- 


output sense. In Section 5.2, we study £ stability of nonlinear systems represented 
by state models. In Section 5.3, we discuss the calculation of the £2 gain for a 
class of time-invariant systems. Finally, in Section 5.4, we present a version of the 
small-gain theorem. 


5.1 CL Stability 
We consider a system whose input-output relation is represented by 
y= Hu 


where H is some mapping or operator that specifies y in terms of u. The input u 
belongs to a space of signals that map the time interval [0, 00) into the Euclidean 
space AR"; that-is, u : [0,oc) — R™. Examples are the space of piecewise con- 
tinuous, bounded functions; that is, sup,>9 ||u(t)|| < oo, and the space of piecewise 


lIn this chapter, we give just enough of a glimpse of the input-output approach to enable 
the reader to understand the relationship of Lyapunov stability to input-output stability and to 
introduce the terminology needed to state the small-gain theorem. For a comprehensive treatment 
of the subject, the reader may consult [53]. [208], or [162]. The foundation of the input-output 
approach to nonlinear systems can be found in the 1960's work of Sandberg and Zames. (See, for 
example, [164], [217], and [218].) 
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: t oo T m. 
continuous, square-integrable functions; that is, Jy u (tyu(t) dt < ie Ea a 
sure the size of a signal, we introduce the norm function lull, which satisfies thr 


properties: 


è The norm of a signal is zero if and only if the signal is identically zero and is 
strictly positive otherwise. 


e Scaling a signal results in a corresponding scaling of the norm; that is, \jeul| = 
a||u|| for any positive constant a and every signal u. 


e The norm satisfies the triangle inequality [|ui + u2l| < luill + fua] for any 
signals u; and us. 


For the space of piecewise continuous, bounded functions, the norm is defined as 
llull = sup |lu(t)|| < oo 
eo 


and the space is denoted by £m. For the space of piecewise continuous, square- 
integrable functions, the norm is defined by 


Ila - V f ” ul (t)u(t) dt < oo 


and the space is denoted by C7. More generally, the space C7 for 1 S p < oo is 


defined as the set of all piecewise continuous functions u : [0, o6) — R™ such that 


oo l/p 
tulle, = ( f OT it) d 


The subscript p in £7 refers to the type of p-norm used to define the space, Kon 
the superscript m is the dimension of the signal u. If they are clear from the haan 
we may drop one or both of them and refer to the space simply as £p, £™, or £. 
To distinguish the norm of u as a vector in the space £ from the norm of u(t) as a 
vector in R™, we write the first norm as || - lc. 


If we think of u € Z^ asa “well-behaved” input, the question to ask is whether 


the output y will be “well behaved” in the sense that y € £5, where £1 is the same 
space as £™, except that the number of output variables q is, in general, different 
from the number of input variables m. A system having the property that any 
“well-behaved” input will generate a “well-behaved” output will be defined as a 
stable system. However, we cannot define H as a mapping from £^ to £4, Dose 
we have to deal with systems which are unstable, in that an input u € L" may 


2Note that the norm ||. [| used in the definition of ||: ||cp, for any p € [1, co], can be any Len 
in R"; the number p is not necessarily the same in the two norms. For example, we may ipn he 
Loo space with |jullc,, = suprso lult) liullz.s = SuPioo llu(E)ll2, or lulle = SuPrao lutlo- 
However, it is common to define the £2 space with the 2-norm in R™. 
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generate an output y that does not belong to £7. Therefore, H is usually defined 
as a mapping from an extended space £7' to an extended space £2, where £7 is 
defined by 

Lr = {u | u, E L™,Y 7 € [0,00)} 


and uy is a truncation of u defined by 


ut), O<Si<¢r . 
«0-1 i >r 


The extended space C7" is a linear space that contains the unextended space L™ as 
a subset. It allows us to deal with unbounded “ever-growing” signals. For example, 
the signal u(t) = t does not belong to the space Loo, but its truncation 


t O<t<r 
w= { rs 


belongs to Læ for every finite r. Hence, u(t) = t belongs to the extended space 
D sos 
A mapping H : £7 — £2 is said to be causal if the value of the output (Hu)(t) 


at any time t depends only on the values of the input up to time t. This is equivalent 
to . 

" (Hu). = (Hur); 
Causality is an intrinsic property of dynamical Systems represented by state models. 


With the space of input and output signals defined, we can now define input- 
output stability. 


Definition 5.1 A mapping H : L” — £4 is L stable if there exist a class K 
function a, defined on [0, oo), and a nonnegative constant B. such that 


Muelle < o (|lurl|c) +8 (5.1) 


for all u € LE and r € [0,oo). It is finite-gain C. stable if there exist nonnegative 
constants y and B such that 


(Hu) € ylusllc +B " (5.2) 
for allu € LE and r € [0, 00). 


The constant 5 in (5.1) or (5.2) is called the bias term: It is included in the definition 
to allow for systems where Hù does not vanish at u = 0:3 When inequality (5.2) 
is satisfied, we are usually interested in the smallest possible y for which there is 8 
such that (5.2) is satisfied. When this value of. y is well defined, we will call it the 


gain of the system. When inequality (5.2) is satisfied with some Y = 0, we say that 
the system has an £ gain less than or equal to y. 


SHE TORRE GENIUM CMM In 
3See Exercise 5.3 for a different role of the bias term. 
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For causal, £ stable systems, it can be shown by a simple argument that 


ue Ll” 2 Huel 
and ; 
Hulle <a (lulc) +8, Vue c" 
For causal, finite-gain £ stable systems, the foregoing inequality takes the form 


|Hullc Sluice +B, Vue c" 


The definition of C. stability is:the familiar notion of bounded-input-bounded- 


output stability; namely, if the system is Loo stable, then for every bounded input 
u(t), the output Hu(t) is bounded. 


Example 5.1 A memoryless, possibly time-varying, function h : [0,co)x RoR 


can be viewed as an operator H that assigns to every input signal u(t) the output 


signal y(t) = h(t, u(t)). We use this simple operator to illustrate the definition of £ 
stability. Let 
] ee zs eo! 
h(u) =a + btanheu=a+b Wu 
for some nonnegative constants a, b, and c. Using the fact 


ae z Sbc, VuceR 


Msc y 


we have 
|h(u)| a4 beu, VueR 


Hence, H is finite-gain Læ stable with y = bc and 6 = a. Furthermore, if a = 0, 
then for each p € [1, co), 


oo eo 
], heo at < oy [^ tutoP at 
0 0 
Thus, for each p € [1, co], the operator H is finite-gain Lp stable with zero bias and 
= bc, Let h be a time-varying function that satisfies 
lh(5v) < alul, Vt>0, Yue R 


for some positive constant a. For each p € [1,00], the operator H is finite-gain £y 
stable with zero bias and y = a. Finally, let 


h(u) =u? 
Since 3 
sup (ul < (sup at} 
t20 t20 
H is Læ stable with zero bias and e(r) = r?. It is not finite-gain Lẹ stable 


because the function h(u) = u? cannot be bounded by a straight line of the form 
|h(u)| € 4|u| + 8. for all u € R. A 
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Example 5.2 Consider a single-input-single-output system defined by the causal 
convolution operator 


t 
y(t) = l h(t — e)u(c) de 
0 
where h(t) = 0 for t < 0. Suppose h € Lie; that is, for every T € [0, co), 
Idle, = [^ Beton do m [Ite de < 00 
0 : 


If u € £4, and T > t, then 


KO) 


IA 


[ ec uolo 


IA 


t t 

h(t—-c)| do sup [u(c S| |A(s)| ds sup lu(e)| 
[wey ao sw itle f E 
Consequently, 


liy llc. < [Relics lure: VTE [0, oo) 


This inequality resembles (5.2), but it is not the same as (5.2) because the constant 
y in (5.2) is required to be independent of r. While ||h,||c, is finite for every finite f. 
it nay not be bounded uniformly in 7. For example, h(t) = e has IAPA = (e —1), 
which is finite for all 7 € [0, 00) but not uniformly bounded in r. Inequality (5.2) 
will be satisfied if h-€ £,; that is, 


llle = [ Iho] de < 00 
Then, the inequality 


lul. < llle Muelle... V 7 € 19,09) 


shows that the system is finite-gain £4, stable. The condition |Allc, < oo actually 
guarantees finite-gain C, stability for each p € [1, co]. Consider first the case p = 1. 
For t € T < oo, we have 


[voa [ 


Reversing the order of integration yields 


[ A(t — e)u(c) dol dt < [ [ \n(t — 2)| |u(o)| do dt 
0 


: "toy [ ht - o)l dt do < [ Into) Wille, do < Welles lerle: 
[voias [non f. we c)| dt do ri e) Halle 


Thus, 
s WIyeller < Velle uelle. V 7 € (9,09) 
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Consider now the case p € (1,00) and let q € (1,00) be defined by 1/p + 1/q = 1. 
For t < T < oo, we have 


[y(t)] 


IA 


|A(t — «)| ju(o)| de 
0 


Í hft- o)l lalt — 0)|!/?Iu(a)| de 
0 


ai ne - «)| às) p ti |A(t — o)| (o)? às) 
(lihre) (f [h(t — e)] [u(c)I? à) T 


where the second inequality is obtained by applying Hólder's inequality. Thus, 
$ ; 
(lole)? = f WOP at 


[rete (f “ist o) luo) ar) dt 
(Ihe le, )* T i |h(t — a)| |u(a)|? do dt 


1/p 


IA. 


lA 


IA 


By reversing the order of integration, we obtain 


(vee)? < (hee ^ ji " ue)? [ "\a(t — 0)| dt do 
(elles)?! Weller (urle)? = (hle) (urle)? 


^ 


IA‘ 


Hence, l 

lige licy S llli: llus le, 
In summary, if ||A||z, < oo, then\for each p € [1, oo], the causal convolution operator 
is finite-gain Lp stable and (5.2) is satisfied with y = |Allc, and 8 = 0. A 


One drawback of Definition 5.1 is the implicit requirement that inequality (5.1) 
or inequality (5.2) be satisfied for all signals in the input space £^, This excludes 
systems where the input-output relation may be defined only for a subset of the 
input space. The next example explores the point and motivates the definition of 
small-signal £ stability that follows the example. 


ae ap OE E EEE . 
3iHálder's inequality states that if f € Lye and g € Lge, where p € (1,00) and 1/p+1/q=1, 


then : , io 3 i 
1 [F(t)a(t)| dt € (/ Jay a) (J lo(t)]* 2 
[U Ju \Jo 


for every 7 € (0, 00). (See {14].) 


Mirari Me e diee "E 


' "'&a. £ STABILITY OF STATE MODELS 201 


Example 5.3 Cousider a single-input-single-output system defined by tlie noulin- 
earity 
y =tanu 


The output y(t) is defined only when the input signal is restricted to 
luf) «5, vtz0 


Thus, the system is not £,, stable in the sense of Definition 5.1. However, if we 
restrict u(t) to the set 


T 
<r<- 
lulsr<5 


tanr 
lyl< (=) |u| 


and the system will satisfy the inequality 


tanr 
Ile, < (525) the, 


for every u € Lp such that |u(t)| € r for all t > 0, where p could be any number 
in [1,00]. In the space Læ, the requirement |u(t)| € r implies that |lullc. X r, 
showing that the foregoing inequality holds only for input signals of small norm. 
However, for other Lp spaces with p < oo the instantaneous bound on |u(t)| does 
not necessarily restrict the norm of the input signal. For example, the signal 


then 


u(t) = re^, g>0 ed m 


which belongs to £, for each p € [1,oo], satisfies the instantaneous bound lu(t)) € v 
while its £j norm 


a 1/p 
lull, - 7 (2) Cpu s 


can be arbitrarily large. A 


Definition 5.2 A mapping H : L™ — L4 is small-signal L stable (respectively, 
small-signal finite-gain L stable) if there is a positive constant r such that inequality 
(5.1) [respectively, inequality (5.2) is satisfied for allu € LẸ? with supos,s, ||u(t)]| € 
r. 


5.2 L Stability of State Models 


The notion of input-output stability is intuitively appealing. This is probably 
why most of us were introduced to dynamical system stability in the framework 
of bounded-input~bounded-output stability. Since, in Lyapunov stability, we put a 


ceti. 


3 


^3 


METER acetal as Maye. ytd saa Bai 


ED 


202 CHAPTER & INPUT-OUTPUT STABILITY 


lot of emphasis on studying the stability of equilibrium points and the asymptotic 
behavior of state variables, one may wonder: What can we see about input-output 
stability starting from the formalism of Lyapunov stability? In this section. we 
show how Lyapunov stability tools can be used to establish £ stability of nonlinear 
systems represented by state models. 

Consider the system 


$i = f(t,z,u), 2(0)=29 (5.3) 
y = A(t,z,u) (5.4) 


where z € R”, u € R™, y € RY, f : [0,00)x Dx D, — R” is piecewise continuous in 
t and locally Lipschitz in (x, u), h : (0,00) x D x D, — R is piecewise continuous in 
t and continuous in (z,u), D C R” is a domain that contains z = 0, and D, C R” 
is a domain that contains u = 0. For each fixed zg € D, the state model given 
by (5.3) and (5.4) defines an operator H that assigns to each input signal u(t) the 
corresponding output signal y(t). Suppose z = 0 is an equilibrium point of the 
unforced system 


€ = f(t, x,0) (5.5) 


The theme of this section is that if the origin of (5.5) is uniformly asymptotically - 


stable (or exponentially stable), then, under some assumptions on f and h. the 
system (5.3) and (5.4) will be £ Stable or small-signal £ stable for a certain signal 
space C. We pursue this idea first in the case of exponentially stability, and then 
for the more general case of uniform asymptotic stability. 


Theorem 5.1 Consider the system (5.3)-(5.4) and take r > 0 and ry > 0 such 
"that {a <r} C D and (]ul| < ru) C Du. Suppose that 
e z:/—:0 isan exponentially stable equilibrium point of (9.5), and therc is a 
Lyapunov function V(t,z) that satisfies i 


EN eillzi? € V(t, x) < ezlzi? (5.6) 
MEN'S UM ur 
E ` [x E Vs “OL + E T, 0) < —cal|z||? (5.7) 
1 aa < caliz|| (5.8) 


for all (t,£) € [0, o0) x.D for some positive constants c, c», ca, and c4. 


e f and h satisfy the inequalities 


lsu) — f(62,0)] € Llull (5.9) 

l(t z 4) |] < mlizi + nuh (5.10) 

for all (t,z,u) € (0,00) x D x Du for some nonnegative constants L. m, and 
m 
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Then, for each zo with ||zol| € ry/ci/co, the system (5.3)--(5.4) is ee 
finite-gain Lp stable for each p € [1,00]. In particular, for each u € Lye wit 
Supoete;, lu (£)]l € min{ry, ciear/(e204L)); the output y(t) satisfies 


- 
ly-lle, € vllu- llc, +8 (5.11) 
for all r € [0, 00), with : 
1, if poo 
pagg Peces 8 = mlizo, | Ž , where p = i 
€1C3 e (2) , if p & [1,00) 


i igin i i ll the assumptions 
Furthermore, if the origin is globally exponentially stable and a 
hold globally M D = R” and D, = R™), then, for each zo € R^, the ASA 
(5.3)-(5.4) is finite-gain Lp stable for each p € [1, oo]. 


Proof The derivative of V along the trajectories of (5.3) satisfies 


oV 
V(t,2,u) ov OY (52,0) + Gemu) = f62,0)] 


—eal|lzlf? + ca Lll lull 
Take W(t) = YVE T0). When V(t.z(t) # 0, use W = V/(2VV) and (5.6) to 


obtain 


ll 
| 
+ 


1A 


; 1 fc caL 
wai (2) w zu 


When V(t, z(t)) = 0, it can be verified? that 
eal 
afer 


DtW(t) < DOTT (5.12) 


Hence, 


lfe caL 
piwas- (2) w elu 


for all values of V(t,z(t)) By (the comparison) Lemma 3.4, W(t) satisfies the 
` inequality 
L : -(t- 2c. 

: —teg /2c2 C4 € (t-7)e3/ 2\\u(r) |) dr 

W(t) <e WUES ; 
Using (5.6), we obtain 

t 
Hatt) < lote te + SE [e t7mm quot ar 
EX 


2cı Jo 


S5 See Exercise 5.6. 
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It can be easily verified that 


lal se and sup lulo) < 2 


0£c «t cca 


ensure that |\x(t)|| € r; hence, z(t) stays within the domain of validity of the 
assumptions. Using (5.10), we have 


t 
lol € e*t the f etm dr + ka ful 623) 
0 
where 
C2 „alm pom ga 2 
: r = olm. k = Pon ka=, a 2c 
Set 


ni) = be", yalt) = ka [e utr dr, us = ka I 


Suppose now that u € Ly, for some p € [1, oo]. Using the results of Example 8.2, it 
can be easily verified that i 

C2 
z| 


lyerlle, € — ule, 


It is also straightforward to see that 
llvsrlle, < Kallurllc, 
As for the first term, yi(t), it can be verified that 
ta if p oo 


viele, Skip, where p= 
l (4). fpei) 


Thus, by the triangle inequality, (5.11) is satisfied with 
; k 
ü y7 f. B=kip 


When all the assumptions hold globally, there is no need to restrict ||zo|| or the 
instantancous values of ||u(£)]|. Therefore, (5.11) is satisfied for each zo € R” and 


u € Lye. B. 


The use of (the converse Lyapunov) Theorem 4.14 shows the existence of a Lya- 
punov function satisfying (5.6) through (5.8). Consequently, we have tlie following 
corollary. 
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Corollary 5.1 Suppose that, in some neighborhood of (x =0,u = 0), the function 
f(t, v, u) is continuously differentiable, the Jacobian matrices [Bf /8z] and [Bf /Ou) 
are bounded, uniformly in i, and h(t,z,u) satisfies (5.10). If the origin x — 0 is an 
exponentially stable equilibrium point of (5.5), then there is a constant rg > 0 such 
that for each zo with ||zo|| < ro, the system (5.3)-(5.4) is small-signal finite-gain 
Lp stable for each p € [1,00]. Furthermore, if all the assumptions hold globally and 
the origin x = 0 is a globally exponentially stable equilibrium point of (5.5), then for 
each zo € R”, the system (5.3)-(5.4) is finite-gain Lp stable for each p € [1,oc]. © 


For the linear time-invariant system 


Az + Bu, (5.14) 
y = Cxet+Du (5.15) 


the global exponential stability condition of Theorem 5.1 is equivalent to the con- 
dition that A is Hurwitz. Thus, we have the following result for linear systems: 


Corollary 5.2 The linear time-invariant system (9.14)-(5.15) is finite-gain Lp sta- 
ble for each p € [1, oo] if A is Hurwitz. Moreover, (5.11) is satisfied with 


T 2X az (PI BINC Amaz(P) 
zlD A, B= IT. 
Y ll ll2 + Dmmin(P) B pllClallzoll PU (P) 
where 
1; if p = oo 
F Mp | 
(2422) , if p€ [1,00) 
and P is the solution of the Lyapunov equation PA + ATP = —I. o 


We leave it for the reader to derive the foregoing expressions for ^y and ff. 
Example 5.4 Consider the single-input-single-output, first-order system 


= -rz-az5-u, z(0)- 29 
tanhe+u 


y 


The origin of ¢ = —z — z? is globally exponentially stable, as can be seen by 
the Lyapunov function V(r) = 22/2. The function V satisfies (5.6) through (5.8) 
globally with cj = c2 = 1/2, c3 = c4 = 1. The functions f and h satisfy (5.9) and 
(5.10) globally with L = m = nz = 1. Hence, for each zo € R and each p € Íl, o9], 
the system is finite-gain £, stable. A 
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Example 5.5 Consider the single-input-single-output second-order system 


di = m 
- $2 = -—z;—293-—atanhzj4u 
Yy = n 


where a is a nonnegative constant. Use 
V(z) = 27 Pr = pz? + 2p122172 + 22222 
as a Lyapunov function candidate for the unforced system: 
V = ~2pio(a}+ax, tanh zy) +2(p11 —p:2 —222)7122—20p2272 tanh z) —2(p22—p12)22 


Choose p11 = 712 + p22 to cancel the cross-product term 2172. Then, taking poo = 
2p12 = 1 makes P positive definite and results in 


V= -z — z — azı tanh z; — 2az3 tanh zi 
Using the fact that z, tanh zı > 0 for all zı € R, we obtain 
V < -lizlĝ + 2a]z] lea] < -(1 — a)leli2 


Thus, for all a < 1, V satisfies (5.6) through (5.8) globally with cj = Amin( P), 
€2 = Amax(P), c3 = 1 — a, and c4 = 2|[P/[2 = 2Amax(P). The functions f and h 
satisfy (5.9) and (5.10) globally with L = m = 1, 72 = 0. Hence, for each ro € R 
and each p € [1, oo], the system is finite-gain £y stable. ^ 


We turn now to.the more general cese when the origin of (5.5) is uniforinly 
asymptotically stable and restrict our attention to the study of Lo stability. The 


next two theorems give conditions for small-signal Læ stability and La stability, 
respectively 


Theorem 5.2 Consider the system (5.3)-(5.4) and take r > 0 such that {llzl| € 
r) C D. Suppose that 


* x = 0 isa uniformly asymptotically stable equilibrium point of (5.5), and there 
is a Lyapunov function V(t,x) that satisfies 


ex(Izl) € V(t, z) € az(llz]]) (5.16) 
A mif (2,0) <—as( lief) (5.17) | 
Fe | < ostien (518) 


for all (t, x) € |0. cc) x D for some class K functions a, to a4. 
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5.2. C STABILITY OF STATE MODELS 


e f and h satisfy the inequalities 
[A (t, z, u) = f(t, 2, o) < os ([u]l) (9.19) 


A(t, a, u)|| € as(lzll) + oll) +7 (5.20) 


for all (t,z,u) € (0,00) x D x Dy for some class K functions as to a7, and a 
nonnegative constant 1. 


Then, for each zo with ||xo|| € az (o:(r)), the system (5.3)-(5.4) is small-signal 


Læ stable. o 
Proof: The derivative of V along the trajectories of (5.3) satisfies 
av 
V (tz, u) = cai + Y f(,,0) + Fg V 6e u) y f(t z, 0)] 
< -ox(lzll) + ea(lizl)asClul) 
< -1 - Bastlel) ~ Bast Hal) + aalr)as ( sup ju) 


where 0 < 6 < 1. Set , 


zi (ses (suPoctcr en) 
r= | — p 


-1 
and choose ry > 0 small enough that (||ul| < Tu} C Du and p < az (ai(r)) for 
SUPo<t<r ju(t)|| < ru. Then, 
Vis -(1-A)as(llell), Vlll > # 
By applying Theorem 4.18, we conclude from (4.42) and (4.43) that ||z(£)ll satisfies 
the inequality 
Jeto < Aliso.)  ( sup Iu) (2) 


for all 0 < t € r, where f and ^; arc class KL and class K functions, respectively. 
Using (5.20), we obtain 


^ 


TOES (ssi + ( sup Ito) + ante +n 


lA 


os 8 (lizojl £)) + as (n (am. tuo) J + os(lu (£I) +7 


sons 6 
where we used the general property of class X functions 


ala +b) € a(2a) + a(2b) 


8See Exercise 4.35. 
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Thus, 

lysle. < Yo llurliea) + Bo (5.22) 
where 


yo — ago2y Fo; and o= oe(2P(lzo]l, 0)) +7 


The use of (the converse Lyapunov) Theorem 4.16 shows the existence of a 
Lyapunov function satisfying (5.16) through (5.18). Consequently, we have the 
following corollary: 

Corollary 5.3 Suppose that, in some neighborhood of (x = 0,u = 0), the function 
f (t, z,u) is continuously differentiable, the Jacobian matrices [Of /Ox\ and [Of /Ou] 
are bounded, uniformly in t, and h(t,z,u) satisfies (5.20). If the unforced system 
(5.5) has a uniformly asymptotically stable equilibrium point at the origin x = 0, 
then the system (5.3)-(5.4) is small-signal Loo stable. © 

To extend the proof of Theorem 5.2 to show Loo stability, we need to demon- 
strate that (5.21) holds for any initial state 29 € R” and any bounded input. As we 
discussed in Section 4.9, such inequality will not automatically hold when the con- 
ditions of Theorem 5.2 are satisfied globally, even when the origin of (5.5) is globally 
uniformly asymptotically stable. However, it will follow from input-to-state stability 
of the system (5.3), which can be checked using Theorem 4.19. 


Theorem 5.3 Consider the system (5.3)-(5.4) with D = R” and D, = R™. Sup- 
pose that 


e The system (5.3) is input-to-state stable. 
e h satisfies the inequality 
I|h (4 2, u)|] < ex (lil) + aa (Iul) +9 (5.23) 


for all (t,z,u) € [0, 00) x R” x R™ for some class K functions o4, a2, and a 
nonnegative constant n. 


Then, for each zo € R”, the system (5.3)~(5.4) is Loo stable. © 


Proof: Input-to-state stability shows that an inequality similar to (5.21) holds 
for any zo € R” and any u € Looe. The rest of the proof is the same as that of 
Theorem 5.2. i (m) 


Example 5.6 Consider the single-input-single-output first-order system 


i = -x—2794(1+2?)v? 
= r +u 


oM a Dei aie SR nena e 


B 8, 
: ze wt a owe t , 
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We saw in Example 4.26 that the state equation is input-to-state stable. The output 
function h satisfies (5.23) globally with a(r) = r?, az(r) = r, and 7 = 0. Thus, 
the system is Læ stable. A 


Example 5.7 Consider the single-input-single-output second-order system 


iàj = —a}+9(t)ae 
—g(t)z, —a3+u 


£2 


li 


y Tı + 22 
where g(t) is continuous and bounded for all t > 0. Taking V = (x? + 23), we have 
y- -2zj ~- 221 + 2r2u 
Using 
zi + 22 2 zle 
yields 
V < -lzlĝ+ 2|zllalu| 
= -(-6)lzli — elel + 2]lelia]ul, 0 «6 «1 
" 2|u| 1 
< -Q-Olelfs V lele z (257) 


Thus, V satisfies inequalities (4.48) and (4.49) of Theorem 4.19 globally, with 
a(r) = a(r) = r?, Ws(z) = -(1 ae 9)llz llo and plr) Em (2r/0)!/2, Hence, the 
state equation is input-to-state stable. Furthermore, the function h = 2; + 22 sat- 
isfies (5.23) globally with o1(r) = V2r, az = 0, and  — 0. Thus, the system is Læ 
stable. : A 


5.3... £a Gain 


£» stability plays a special role in systems analysis. It is natural to work with square- 
integrable signals, which can be viewed ‘as finite-energy signals."..In many control 
problems, the system is represented as an input-output map, from.a disturbance 
input u to a controlled output y, which is required to be small:;With.£y input 
signals, the control system is designed to make the input-output map finite-gain 
Lz stable and to minimize the £2 gain. In such problems, it is important not only 
to be able to find out that the system is finite-gain £2 stable, but also to calculate 
the £2 gain or an upper bound on it. In this section, we show how to calculate the 
£2 gain for a special class of time-invariant systems., We start with linear systems. 

TIf you think of u(t) as current or voltage, then uT(t)u(i) is proportional to the instantaneous 


power of the signal, and its integral over all time is a measure of the energy content of the signal. 
8See the literature on H- control; for example, (20], [54], [61], [90], [199], or [219]. 
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Theorem 5.4: Consider the linear time-invariant system 


dom. Ar + Bu (5.24) 
id =" Cr+ Du (5.25) 


E where A is. ` Hurwitz.. Let G(s) = C(sI — A) 1B +D. Then, the £ gain of the 
A system is SUP eR | G(ju)lo-? o 


Proof: Due to linearity, we set z(0) = 0. From Fourier transform theory,!? 
know that for a causal signal y € £2, the Fourier transform Y (jw) is given by 


¥ (jw) = ji "ye?" dt 


and 
Y (jw) = G(jw)U (jw) 


Using Parseval’s theorem,!! we can write 


M 


"m [vous ee LY'Go)Y Go) de 


27 


1l 


xl. U* Badia S 


= lete) az [^ nono de 


(sup Nile) lul, 


l^ 


which shows that the £2 gain is less than or equal to supper lG(jw)]|a. Showing 
. that the £2 gain is equal to sup,eg ||G(jw)|l2 is done by a contradiction argument 
that is given in Appendix C.10. [n 


The case of linear time-invariant systems is exceptional in that we can actually 
find the exact £2 gain. In more general cases, like the case of the next theorem, we 
can only find an upper bound on the £2 gain. 


This. is .the. "induced : .2-norm. of .the complex ` matrix... G(ju), which is equal to 


V Anex [GT (—J0) GGu)]. = maxi Gu]]:- This quantity is known as the Hæ norm of G(jw), 
when-G(jw) is viewed as an element of the Hardy space Hoo. (See [61].) : 

10See [53]. 

1! Parseval’s theorem [53] states that for a causal signal y € La, 


ri v (ut) d= È ru GY Ufa) ds 
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Theorem 5.5 Consider the time-invariant nonlinear system 


é.= f(z)+G(z)u, 2(0) = zo (5.26) 
ya. ^ | (5.27) 
where. f(x) is locally Lipschitz, and G(x), h(x) are continuous over R^. The matriz 
G isn x m and h : R” — RI. The functions f and h vanish at the origin; 


that is, f (0) = 0 and h(0) = 0. Let y bea positive number ànd. suppose there is 
a continuously differentiable, positive semidefinite function V(x) that satisfies the 


` inequality 
T 
A(V, f, G, hy) £ oY fla)+ z)- 245 G(s)GT(z) (2). +E (hle) < 0 (5.28) 
n = Ox 2 

for all x € R”. Then, for each zo € R^, the system (5.26) (5. 27) is finite-gain L2 
stable and its La gain is less than or equal to y. o 
Proof: By completing the squares, we have 

av av 5 17, aV av 

alar Keen = -37 h- 507) (FZ) | r0 


2 


Substituting (5.28) yields 


AE 37? fu 


Hence, a a j i 
ZA i 2I — Ay, 2 
SoA a) + Glew < z lulh - z luli (5.29) 


Note that the left-hand side of (5.29) is the derivative of V along the trajectories 
of the system (5.26). Integrating (5.29) yields 


1 T Tuff 
Visto) - V) s 5? [uci dt 5 f Itti a 
where z(t) is the solution of (5.26) for a given u € Loe. Using V(x) 2 0, we obtain 
f wokas? f lis dt + 2V (20) 
0 ) 


Taking the square roots and using the inequality Va? + 6? € a +b for nonnegative 
numbers a and b, we obtain 


lu-lle; € ^lu-llc, + V/2V (zo) (5.30) 
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which completes the proof. a 


Inequality (5.28) is known as the Hamilton-Jacobi inequality (or the Hamilton- 
Jacobi equation when < is replaced by =). The search for a function V (x) that sat- 
isfies (5.28) requires basically the solution of a partial differential equation, which 
might be difficult to solve. If we succeed in finding V (x), we obtain a finite-gain 
Ly stability result, which, unlike Theorem 5.1, does not require the origin of the 
unforced system to be exponentially stable. This point is illustrated by the next 
example. dE 


Example 5.8 Consider the single-input-single-output system 


$i = 2 
$2 = —az] —, kzz +u 
y = 2 


where a and k are positive constants. The unforced system is a special case of 


' the class of systems treated in Example 4.9. In that example, we used the energy- 


like Lyapunov function V(x) = az1/4 + z2/2 to show that the origin is globally 
asymptotically stable. Using V(x) = o(az1/4 + z2/2) with a > 0 as a candidate 
for the solution of the Hamilton-Jacobi inequality (5.28), it can be shown that 


HUV, f,G, ho) = (ok + 5 +1) 3 
J, G, 2,7) = 22 D, r5 


To satisfy (5.28), we need to choose a > 0 and y > 0 such that 
c1 

—-ak4a —---« B 
a tatz? (5.31) 


By simple algebraic manipulation, we can rewrite this inequality as 


a? 


PES 
TO Tae 


Since we are interested in the smallest possible y, we choose a to minimize the 


right-hand side of the preceding inequality. The minimum value 1/k? is achieved 
at a = 1/k. Thus, choosing y = 1/k, we conclude that the system is finite-gain 
£2 stable and its £2 gain is less than or equal to 1/k. We note that the conditions 
of Theorem 5.1 are not satisfied in this example because the origin of the unforced 
system is not exponentially stable. Linearization at the origin yields the matrix 


i 


[o À] 


which is not Hurwitz. A 


The idea of the preceding example is generalized in the next one. 


Example 5.9 Consider the nonlinear system (5.26)-(5.27), with m = q, and sup- 
pose there is a continuously differentiable positive semidefinite function W(x) that 
satisfies!? 


a (z) < -kh"(z)h(z k»0 (5.32) 
Male) = AT(x) (5.33). 


for all z € R^. Using V(x) = aW (x) with a > 0 as a candidate for the solution of 
the Hamilton-Jacobi inequality (5.28), it can be shown that 


o? Y, 
^(V, f, G,h, y) = (-ai+ a + 3) h? (x)h(x) 


To satisfy (5.28), we need to choose a > 0 and y > 0 such that 
a 1 
- —z t+ 
ak + 22 + PES 0 
This inequality is the same as inequality (5.31) of Example 5.8. By repeating the 


argument used there, it can be shown that the system is finite-gain £2 stable and 
its £2 gain is legs than or equal to 1/k. A 


Example 5.10 Consider the nonlinear system (5.26)-(5.27), with m = q, and sup- 
pose there is a continuously differentiable positive semidefinite function W (x) that 
satisfies! 


i fle) < 0 (5.34) 
ow cla) = h'(x) (5.35) 


` for all z € R^. The output feedback control 


u=—ky+v, k>0 


results in the closed-loop system 


T 
è = fey-kelne" (ZE) at» fle) + Gla) 
T 
y = Na) = Ga (2) 


124 system satisfying (5.32) and (5.33) will be defined in the next chapter as an output strictly 
passive system. : 

13A system satisfying (5.34) and (5.35) will be defined in the next chapter as a passive system. 
We will come back to this example in Section 6.5 and look at it as a feedback connection of two 
passive systems. 
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It can be easily verified that, for the closed-loop system, W (z) satisfies (5.32) and 
(5.33) of the previous example. Hence, the input-output map from v to y is finite- 
gain £2 stable and its £2 gain is less than or equal to 1/k. This shows, in essence, 
that the £2 gain can be made arbitrarily small by choosing the feedback gain k 
sufficiently large. A 


Example 5.11 Consider the linear time-invariant system 


t = Ar+Bu 
y = Cr 


Suppose there is a positive semidefinite solution P of the Riccati equation 
1 
PA+A™P+ zPBB'P +C™C=0 (5.36) 


for some 4 > 0. Taking V(r) = (1/2)27 Px and using the expression [2V/0x] = 
a’ P, it can be easily seen that V(z) satisfies the Hamilton-Jacobi equation 


H(V, Az, B,Cz) = zT PAr + pat" PBT BPs + 5aTOTCs =0 


Hence, the system is finite-gain C2 stable and its £2 gain is less than or equal to 
y. This result gives an alternative method for computing an upper bound on the 
£2 gain, as opposed to the frequency-domain calculation of Theorem 5.4. It is 
interesting to note that the existence of a positive semidefinite solution of (5.36) is 
a riecessary and sufficient condition for the Cz gain to be less than or equal to ^.!4 


A 
In Theorem 5.5, we assumed that the assumptions hold globally. It is clear from 


the proof of the theorem that if the assumptions hold only on a finite domain D, 
we will still arrive at inequality (5.30) as long as the solution of (5.26) stays in D. 


Corollary 5.4 Suppose the assumptions of Theorem 5.5 are satisfied on a domain 
D C R^ that contains the origin. Then, for any zo € D and any u € Loe for which 
the solution of (5.26) satisfies x(t) € D for allt € [0,7], we have 


llus lle € llull: + 2V (zo) 
o 


Ensuring that the solution x(t) of (5.26) remains in some neighborhood of the ori- 
gin, when both ||zol| and supo«:«-l|u(t)]| are sufficiently small, follows from asymp- 
totic stability of the origin of ¢ = f(x). This fact is used to show small-signal £; 
stability in the next lemma. 


See [54] for the proof of necessity. 
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Lemma 5.1 Suppose the assumptions of Theorem 5.5 are satisfied on a domain 
DC R” that contains the origin, f(x) is continuously differentiable, and z = 0 is 
an asymptotically stable equilibrium point of z= f(x). Then, there is kı >0 such 
that for each zo with ||zol| € ki, the system (5.26)-(5.27) is small-signal finite-gain 
Ly stable with Lo gain less than or equal to y. o 


Proof: Take r > 0 such that (|z| < r} C D: By (the converse Lyapunov) The- 
orem 4.16, there exist ro > 0 and a continuously differentiable Lyapunov function 
W (z) that satisfies 
ai (lizll) < W(z) < ox(lzll) 
oW 
2/09 < —-oas(lizll) 
for all ||z]] < ro. for some class K functions a; to a3. The derivative of W along 
the trajectories of (5.26) satisfies 
We ' 
Wiss) = 2 r0) e D fte) -eo < -ollel + AL 
< -(1-A)as(ll2) - faale) + kL, sup. l(t) 


I^ 


- - Sese). ¥ lel > as? (HE, sup quote) 


where k is an upper bound on ||DW/Oz||. L is a Lipschitz constant of f with respect 
to u. and 0 « 0 < 1. Similar to the proof of Theorem 5.2, we can apply Theorem 4.18 
to show that there exist a class KL function f, a class X function 7, and positive 
constants k and kz such that, for any initial state zo with |zol| < kı and any input 
u(t) with supp<r<; |lu(t)|] S k2, the solution x(t) satisfies 


Isto < leal v ( sup Into) 


for all 0 € t € r. Thus, by choosing kı and kz small enough, we can be sure that 
liz (£)]| <7 for all 0 € t € r. The lemma follows then from Corollary 5.4. im] 


To apply Lemma 5.1, we need to check asymptotic stability of the origin of £ = f (z). 
This task can be done by using linearization or searching for a Lyapunov function. 
The next lemma shows that, under certain conditions, we can use the same function 
V that satisfies the Hamilton-Jacobi inequality (5.28) as a Lyapunov function for 
showing asyniptotic stability. 

Lemma 5.2 Suppose the assumptions of Theorem 5.5 are satisfied on a domain 
DC R” that contains the origin, f(x) is continuously differentiable, and no solution 
of $ = f(x) can stay identically in S = {x € D | h(x) = 0} other than the trivial 
solution z(t) =0. Then, the origin of f= f(x) is asymptotically stable and there is 
ky > 0 such that for each zo with \|xo|| < kı, the system (5.26)-(5.27) is small-signal 
finite-gain Lo stable with Lz gain less than or equal to +. o 
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Proof: Take u(t) z 0. By (5.28), we have 
V(z) = a f(z) X - 4àT(z)h(z), Vr € D (5.37) 
z 


Take r > 0 such that B, = (||z] € r) C D. We will show that V(x) is positive 
definite in B,. Toward that end, let ¢(t; x) be the solution of ¢ = f (x) that starts 
at ¢(0;z) = z € B,. By existence and uniqueness of solutions (Theorem 3.1) and 
continuous dependence of the solution on initial states (Theorem 3.4), there exists 
6 > 0 such that for each z € B, the solution ¢(é;z) stays in D for all t € [0, ô]. 
Integrating (5.37) over [0,7] for 7 € ô, we obtain 


V(ériz)) -V(z) <- 3 f " alalt: 2)? dt 


Using V(ó(r;z)) 2 0, we obtain 


V(z)2 i [ " Ihla) di 


Suppose now that there is Z " 0 such that V(z) = 0. The foregoing inequality 
implies that 


[ oet ao, v reti o Motion, Vee (od 
0 


Since during this interval the solution stays in 5 and, by assutnption, the only 
solution that can stay identically in S is the trivial solution, we conclude that 
o(t;z) = 0 > £ = 0. Thus, V(x) is positive definite in B,. Using V(x) as a 
Lyapunov function candidate for t = f(z), we conclude from (5.37) and LaSalle’s 
invariance principle (Corollary 4.1) that the origin of ¢ = f(x) is asymptotically 
stable. Application of Lemma 5.1 completes the proof. a 


Example 5.12 As a variation on the theme of Examples 5.8 and 5.9, consider the 
system 


di = 9 


dg = -a(z — ġx])— krz +u 
yen 


where a, k > 0. The function V(x) = a [a (x?/2 — x}/12) + 23/2], with a > 0, 
is positive semidefinite in the set (|zi| < V6}. Using V(z) as a candidate for the 
solution of the Hamilton-Jacobi inequality (5.28), it can be shown that 


(V, f,G,h.y) = ~ok + 2543) a3 
(V. f, ALY) = a oy? 9 2 


54. FEEDBACK SYSTEMS: THE SMALL-GAIN THEOREM 


Repeating the argument used in Example 5.8, it can be easily seen that by choosing 
a = 7 = 1/k, inequality (5.28) is satisfied for all z € R?. Since the conditions 
of Theorem 5.5 are not satisfied globally, we investigate small-signal finite-gain 
stability by using Lemma 5.1. We need to show that the origin of the unforced 
system is asymptotically stable. This can be shown by linearization at the origin, 
which results in a Hurwitz matrix. Alternatively, we can apply Lemma 5.2, whose 
conditions are satisfied in the domain D = {|z,| < V3), because j 


xo(t) = 0 > zi(t)[8 - 22(0] =0 > zi(t) =0 


Thus, we conclude that the system is small-signal finite-gain £2 stable and its £2 
gain is less than or equal to 1/k. A 


5.4 Feedback Systems: The.Small-Gain. Theorem : ; 


The formalism of input-output stability is particularly useful in studying stability 
of interconnected systems, since the gain of a system allows us to track how the 
norm of a signal increases or decreases as it passes through the system. This is 
particularly so for the feedback connection of Figure 5.1. Here, we have two systems 


Hy: L? — L3.and H3 : L3 — £7. Suppose both systems are finite-gain £ stable;!5 
that is, 


lirle S mllelz A Ve € L7, vr € l0, o0) (5.38) 
luc S ^lezilz--82, Veo € £2, Vr€10,oo) (5.39) 


Suppose further that the feedback system is well defined in the sense that for every 
pair of inputs u; € £7 and ug € Li, there exist unique outputs e1, y2 € L? and 
e2,31 € £1.19 Define 


-[z] [2] 02] 

u2 ya €2 

The question of interest is whether the feedback connection, when viewed as a 
mapping from the input u to the output e or a mapping from input u to the output 
y, is finite-gain £ stable.!” It is not hard to see (Exercise 5.21) that the mapping 
from u to e is finite-gein £ stable if and only if the mapping from v to y is finite-gain 
£ stable. Therefore, we can simply say that the feedback connection is finite-gain 


151 this section, we present a version of the classical small-gain theorem that applies to finite- 
gain £ stability. For more general versions which apply to £ stability, see [93] and [123]. 

18Sufficient conditions for existence and uniqueness of solutions are available in the literature. 
The most common approach uses the contraction mapping principle. (See, for example, [53, 
Theorem III.3.1].) A more recent approach that makes use of existence and uniqueness of the 
solution of state equations can be found in [93]. 


17See Exercise 5.20 for an explanation of why we have to consider both inputs and outputs in 
studying the stability of the feedback connection, 
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Figure 5.1: Feedback connection. 


£ stable if either mapping is finite-gain £ stable. The following theorem, known as 
the small-gain theorem, gives a sufficient condition for finite-gain £ stability of the 
feedback connection. 


Theorem 5.6 Under the preceding assumptions, the feedback connection is finite- 
gain L stable if ny € 1: o 


Proof: Assuming existence of the solution, we can write 


Cir = Uir —(Hoe2),, Car = uzr + (Hie); 


Then, 
lesse S urle + (A2ea)rile S luisle + alez lle + 2 
S luille +a Clio le + lese lle +81) + 82 
= wvllexllc + (luille t y2lluerllc + Ge + 281) 
Since 7172 < 1, 
1 
llerrllc < 1-4, 7l + *alluzs lle + 2 + 201) (5.40) 


for all r € [0, co). Similarly, 


1 
llearlle < a (uzle + villusellc + 41 + 162) (5.41) 


for all r € [0,00). The proof is competed by noting that llellc X lleillc + lleallc, 
which follows from the triangle inequality. D 
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The feedback connection of Figure 5.1 provides a convenient setup for studying 
robustness issues in dynamical systems. Quite often, dynamical systems subject 
to model uncertainties can be represented in the form of a feedback connection 
with Hi, say, as a stable nominal system and H; as a stable perturbation. Then, 
the requirement 4,2 < 1 is satisfied whenever y2 is small enough. Therefore, 
the small-gain theorem provides a conceptual framework for understanding many 
of the robustness results that arise in the study of dynamical systems, especially 
when feedback is used. Many of the robustness results that we can derive by using 
Lyapunov stability techniques can be interpreted as special cases of the small-gain 
theorem. . 


Example 5.13 Consider the feedback connection of Figure 5.1. Let H, be a linear 


time-invariant system with a Hurwitz square transfer function matrix G(s) = C(sI— 
A)*! B. Let Hz be a memoryless function ez = Y(t, y2) that satisfies 


I(t, y)ll2 S mllylo, Vvt20 Vy eR” 


From Theorem 5.4, we know that H; is finite-gain £2 stable and its £2 gain is given 
by 
"n = sup [[G(w)llz 
weR 


We have seen in Example 5.1 that H3 is finite-gain £2 stable and its £2 gain is less 
than or equal to y2. Assuming the feedback connection is well defined, we conclude 
by the small-gain theorem that it will be finite-gain £2 stable if 1*2 < 1. A 


Example 5.14 Consider the system 


t = f(t,c,u+d,(t)) 
eg = Az+Blutda(t)] 
v = Cz 


where f is a smooth function of its arguments, A is a Hurwitz matrix, -CA^ 1B = J, 
€ is a small positive parameter, and d, dz are disturbance signals. The linear part 
of this model represents actuator dynamics that. are, typically, much faster than the 
plant dynamics represented here by the nonlinear equation £ = f. The disturbance 
signals dı and da enter the system at the input of the plant and the input of the 
actuator, respectively. Suppose the disturbance signals dı and dz belong to a signal 
space L, where £ could be any Lp space, and the control goal is to attenuate the 
effect of this disturbance on the state z. This goal can be met if feedback control can 
be designed so that the closed-loop input-output map from (di, d) to z is finite- 
gain £ stable and the £ gain is less than some given tolerance ó > 0. To simplify 
the design problem, it is common to neglect the actuator dynamics by setting € = 0 
and substituting v = -C AT! B(u + d2) = u+ dz in the plant equation to obtain the 
reduced-order model 
t= f(tr,ucd) 
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where d = d; +d). Assuming that the state variables are available for measurement, 
we use this model to design a state feedback control law u = ^(t, z) to meet the 
design objective. Suppose we have succeeded in designing a smooth state feedback 
control u = y(t, z) such that 


llle < ylldllc +8 (5.42) 


for some y < 6. Will the control meet the design objective when applied to the 
actual system with the actuator dynamics included? This is a question of robustness 
of the controller with respect to the unmodeled actuator dynamics. When the 
control is applied to the actual system, the closed-loop equation is given by 


f(t,z, Cz + di(t)) 
Az + Bly(t,x) + do(t)) 


i 


tt 


EZ 
Let us assume that do(t) is differentiable and dy € £. The change of variables 
n =z + A`! Bjy(t, £) + delt)] 
brings the closed-loop system into the form 
- f(t, 2, y(t, m) + d(t) + Cn) 
An + eA Bly + ds(t)) 


i 
Eù 


where P 0 

ucc 
It is not difficult to see that the closed-loop system can be represented in the form 
of Figure 5.1 with H defined by 


t = f(t, z, (t, 2) + e1) 
PET T 
Mim TS g t gg Canta) + en) 


H, defined by 
1 
om n+ A” Be, 
v2 -Cm 


and 

ul =d t da — d, uz = d2 
In this representation, the system Hy is the nominal reduced-order closed-loop sys- 
tem, while Ho represents the effect of the unmodeled dynamics. Setting € = 0 


181) Example 11.14, we investigate a similar robustness problem, in the context of stabilization, 
using singular perturbation theory. 
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opens the loop and the overall closed-loop system reduces to the nominal one. Let 
us assume that the feedback function +(t, x) satisfies the inequality 


ey 
ot 
for all (t, z, e1), where c; and cz are nonnegative constants. Using (5.42) and (5.43), 
it can be shown that | li 


ay 
*Ax (62, (5, 2) + €1)]] &.ellzll + eolleiil (5.43) 


llle € vilele + A 
where i 
nN=ayte, =p 


Since Hp is a linear time-invariant system and A is Hurwitz, we apply Corollary 5.2 
to show that Hp is finite-gain £p stable for any p € [1,00] and 


llvolle < "ollealle + &» 5 evslleallc + Be 


where 
| 222.4 (Q)I A" Bllal[C o Amaz(Q) 
Ys ema » Be = pllCllal|n(0)|| Ann(Q) 
E 1, if p = oo 


(2st). if p € [1, 00) 


p 


and Q is the solution of the Lyapunov equation QA - ATQ = —[.19 Thus, assuming 
the feedback connection is well defined, we conclude from the small-gein theorem 
that the input-output map from u to e is £ stable, From (5.40), we have 


lerle < 15 lale enl + er + Be 
Using l 

izle S ylleille +8 
which follows from (5.42), and the definition of u and ug, we obtain 


4 ; 
P RE 
IItlle S y= er [dlc Fevrldale evrfi-- R]-- 8 — (5.44) 
It is interesting to note that the right-hand side of (5.44) approaches 
^lldlle +B + bz 


as € — 0, which shows that for sufficiently small € the upper bound on the £ gain 
of the map from d to z, under the actual closed-loop system, will be close to the 
corresponding quantity under the nominal closed-loop system. A 


SR PL a eee 
13 P of Corollary 5.2 is taken as €Q so that (€Q)(A/e) + (A/e)7 (EQ) = =I. 
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5.5 Exercises 


5.1 Show that the series connection of two £ stable (respectively, finite-gain £ 
Stable) systems is £ stable (respectively, finite-gain £ stable). 


5.2 Show that the parallel connection of two £ stable (respectively, finite-gain £ 
stable) systems is £ stable (respectively, finite-gain £ stable). 


5.3 Consider a system defined by the memoryless function y = ul/3, 

(a) Show that the system is Læ stable with zero bias. 

(b) For any positive constant a, show that the system is finite-gain Le stable with 
y= a and f  (1/a)!2. 

(c) Compare the two statements. 

5.4 Consider a system defined by the memoryless function by y = h(u), where 
h: R” — Ri is globally Lipschitz. Investigate Lp stability for each p € [1, 00] when 
(1)h(0 20. (2) A(O) #0. 

5.5 For each of the relay characteristices shown in Figure 5.2, investigate Loo and 

Le stability. - 


5.6 Verify that D+ W(t) satisfies (5.12) when V(t, z(t)) = 0. 
Hint: Using Exercise 3.24, show that V(t + h z(t + h)) < cah? L2|u|?/2 +h ofh), 
where o(h)/h — 0 as h — 0. Then, use the fact that c4 2 2c. 


5.7 Suppose the assumptions of Theorem 5.1 are satisfied, except (5.10), which is 
replaced by 
lhl x, |] S mlel + nallull + ns. ns > 0 


Show that the system is small-signal finite-gain La stable (or finite-gain Læ stable, ji 
if the assumptions hold globally) and find the constants y and @ in (5.11). . 


5.8 Suppose the assumptions of Theorem 5.1 are satisfied, except (5.10), which is 
replaced by (5.20). Show that the system is sinall-signal Lo stable (or Loo stable, 
if the assumptions hold globally). 


5.9 Derive a result similar to Corollary 5.2 for linear time-varying systems. 


5.10 For each of the following systeins, investigate Lo and finite-gain Loo stability: 


è = -(l+u)z3 è = —-(ltu)z3-25 
(1) your (2) y = ortu 

£o = -r/(1+z?)+u $ = -r-r tru 
(3) y = r/(14:°) (4) y = rsinu 
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(a) On-off with hysteresis (b) On-off with dead zone and hysteresis 


y V 


(c) Ideal on-off (d) On-off with dead zone 


Figure 5.2: Relay characteristics 


5.11 For each of the following systems. investigate Lo and finite-gain Lo stability: 


(1)  £j2-—z + 2220, ty = -—r]— t2 +u, yir 
(2 4, =—2, +20, - 3 = =z — t2 +u, y = 22 
(3) Z-(n-cw(lzld—1)  i»-zs(llzl2 — 1), ym 


(4) Ti = Ti ~ T2 + uj, t2 = T1 — T3 + u2, 


P = 2 à 
(8) Tı = ~21 +222, t2 = t1- T2 +u, 
(6) Ti = T2, Í = ~3 — 12 +u, y= Ze 


(7) i = =T ` T2, $9 —-2)1—234du, 


where T > 0. 
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5.12 Consider the system 
di; — do—-y-h(y)tw  y-mtz 


where h is continuously differentiable, h(0) = 0, and zh(2) > az? for all z € R, for 
some a > 0. Show that the system is finite-gain C stable for each p € [1, co]. 


5.13 ([192]) Consider the time-invariant system 
i-jf(ru, y=A(z,u) 


where f is locally Lipschitz, h is continuous, f(0,0) = 0, and ^(0,0) = 0. Suppose 
there is a continuously differentiable, positive definite, radially unbounded function 
V(z) such that 


BV (5,2) & -W(z) + Blu), V (z,u) 
Ox 


where W(x) is continuous, positive definite, and radially unbounded, %(u) is con- 
tinuous, and (0) = 0. Show that the system is Lo, stable. 


5.14 Let H (s) be a Hurwitz strictly proper transfer function, and h(t) = £7! (H(s)) 
be the corresponding impulse response function. Show that 


sup |H(jw)| € f |h(£)] dt 
wER 0 


5.15 For each of the following systems, show that the system is finite-gain (or 
small-signal finite-gain) £2 stable and find an upper bound on the £2 gain: 


ij = Z9 4 ij = -T2 $ E 

i9 = -asing > kro +u (2) £9 = q1- T2 sat(x} — 13) + zzu 
(1) y ^ r : is = T3 sat(2 — x4) — zat 

a>0,k> \ y = 23-33 

dq = 22 di = 2 R : 

(3) £2 = qı- sat(2rı + T2) + u (4) £9 = -(i-c-zj)2—-zit zi 
y = t y = x 
5.16 Consider the system 
tı = -T1 + 22, ho = —T) — a(zı)— z2 +u, y = T2 


where ø is locally Lipschitz, ø (0) = 0, and zo(z) > 0 for all z € R. 
(a) Is the system finite-gain Lo stable? 


(b) Is it finite-gain L2 stable? If yes, find an upper bound on the £2 gain. 


5.5. EXERCISES 


|o 25 8 


$.17 ([77]) Consider the system 
£-Jf(z)4 G(z)u, y = h(x) + J(z)u 


where f, G, h, and J are smooth functions of x. Suppose there is a positive constant 
y such that 421 — JT (z)J(z) > 0 and 


20V. ifr, 3V ~1 8V ]" | 1 $ 
n-uieup 3+ Lal 1-772) [avs + e| + hh <0 


V x. Show that the system is finite-gain Lz stable with £z gain less than or equal 
to y. Í 
Hint: Set 


T 
PI-JT (2)J(2) = W'(sW(z), La) =~ [W7] [rewa " Feats) 
z 
and show that the following inequality holds Y u 
OV. OV 1 2 
à: t 50" =- zE +Wau)T[L + Wu] + Taulu - Syty +H 
5.18 ([199])* Consider the system 


å = f(z) + G(z)  K(z)w, y=A(z) 


where u is a control input and w is a disturbance input. The functions f, G, K, 
aud h are smooth, and f(0) = 0, A(0) = 0. Let y > 0. Suppose there is a smooth 
positive semidefinite function V(x) that satisfies 


V 10V T 
3; 79) Tam EL dT - Get) (zz) + sh (a)h(a) <0 


V z. Show that with the feedback control u = —GT(z)(0V/0z)7 the closed-loop 
map from w to | , | is finite-gain L2 stable with £z gain less than or equal to y. 


5.19 ([200]) The purpose of this exercise is to show that the Lo gain of a linear 
time-invariant system of the form (5.24)-(5.25), with a Hurwitz matrix A, is the 
same, whether the space of functions is defined on R} = (0,00) or on the whole 
real line R = (—00, 00). Let £2 be the space of square integrable functions on Ry 
with the norm |ullZ, = fj" u7 (t)u(t) dt and Lop be the space of square integrable 
functions on R with the norm ||u|2,, = [°, uT(t)u(t) dt. Let y2 and yor be the 
L2 gains on L2 and Lor, respectively. Since £4 is a subset of Lor, it is clear that 
om Ser. We will show that +2 = 42g by showing that, for every € > 0, there is a 
signal u € £2 such that y € £ and |lylle, > (1 — €)yzallullc,. 
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(a) Given € > 0 show that we can always choose 0 « ó < 1 such that 


1-¢/2~- V5 
v1-ó 


(b) Show that we can always select u € Lor and time tı < oo such that 


21-e 


Velon=1, dies 2 men (1~5), f vu dus 


(c) ks n = u1 (t) +u2(t), where u; vanishes for ¢ < tı and ug vanishes for t > t 
et y1(t) be the output corresponding to the input u(t). Show that T 


llega .. 1 -€/2- võ 
lun; nr MR cM 


(d) zm re u(t) mea by u(t) = w(t + tı) and y(t) = y(t + £j). 
u and y belong to L2, y(t) is the output correspondi 
u(t), and [lyllc, 2 (1 — e)vonl|ullc;. vee 


5.20 Consider the feedback connection of Figure 5.1, where i 
time-invariant systems represented by the cae functions pares DAD 
and Ho(s) = 1/(s — 1). Find the closed-loop transfer functions from (u1, u2) to 
(yi, y2) and from (u1,u2) to (ei, eg). Use these transfer functions to discuss Si 
we have to consider both inputs (u1, u2) and both outputs (e1,e2) (or (yi, ) in 
studying the stability of the feedback connection. pene 


5.21 Consider the feedback connection of Fi 
igure 5.1. Show that the mapping fi 
(u1, u2) to (yi, ya) is finite-gain £ stable if and i i Vie 
, 2 3 only if th 
(e1, e2) is finite-gain £ stable. d i 


5.22 Let do(t) = asinwt in Example 9.14, where a and w are positive constants. 


(a) Show that, for sufficiently small ¢, the state of the closed-loop system is uni- 


formly bounded. 
(b) Investigate the effect of increasing w. 


5.23 i i i 
by Consider the feedback connection of Figure 5.1, where H) and H3 are given 


ii = —ZpTI B 3 
Hj H Ta = E — £9 +e, and Ha H { ENS CES +e 
iis mE y = (1/223 


Let u2 = 0, u = u be the input, and y = y; be the output. 
(a) Using x = [ri, 22, zal? as the state vector, find the state model of the system. 


(b) Is the system Z2 stable? 


Chapter 6 


Passivity 


Passivity provides us with a useful tool for the analysis of nonlinear systems, which 
relates nicely to Lyapunov and £2 stability. We start in Sectiou 6.1 by defining pas- 
sivity of memoryless nonlincarities. We extend the definition to dynamical systems, 
represented by state models, in Section 6.2. In both cases, we use electrical networks 
to motivate the definitions. In Section 6.3, we study positive real and strictly posi- 
tive real transfer functions and show that they represent passive and strictly passive 
systems, respectively. The connection between passivity and both Lyapunov and 
£3 stability is established in Section 6.4. These four sections prepare us to address 
the main results of the chapter. namely. the passivity theorems of Section 6.5. The 
main passivity theorem states that the (negative) feedback connection of two passive 
systems is passive. Under additional observability conditions, the feedback connec- 
tion is also asymptotically stable. The passivity theorems of Section 6.5 and the 
smail-gain theorem of Section 5.4 provide a conceptually important generalization 
of the fact that the feedback connection of two stable linear systems will be stable 
if the loop gain is less than one or the loop phase is less than 180 degrees. The 
connection between passivity and the phase of a transfer function comes from the 
frequency-domain characterization of positive real transfer functions, given in Sec- 
tion 6.3. There we know that the phase of a positive real transfer function cannot 
exceed 90 degree. Hence, the loop phase cannot exceed 180 degrees. If one of the 
two transfer functions is strictly positive real, the loop phase will be strictly less 
than 180 degrees. Section 6.5 discusses also loop transformations, which allow us, 
in certain cases, to transform the feedback connection of two systems that may not. 
be passive into the feedback connection of two passive systems, hence extending the 


utility of the passivity theorems. 
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E toy 

S 

E u 

i» 

S = 

E Figure 6.1: (a) A passive resistor; (b) u-y characteristic lies in the first-third quadrant. 
e 

P i 

A 6.1  Memoryless Functions 

E 

A Our goal in this section is to define passivity of the memoryless function y = h(t, u), 
Di where h : [0,00) x RP — RP. We use electric networks to motivate the definition. 
E Figure 6.1(a) shows a one-port resistive element with voltage u and current y. We 
E view this element as a system with input u and output y. The resistive element 


is passive if the inflow of power is always nonnegative; that is, if uy > 0 for all 
points (u, y) on its u-y characteristic. Geometrically, this means that the u-y curve 
must lie in the first and third quadrants, as shown in Figure 6.1(b). The simplest 
such resistive element is a linear resistor that obeys Ohm's law u = Ry or y = Gu, 
where R is the resistance and G = 1/R is the conductance. For positive resistance, 
the u-y characteristic is a straight line of slope G and the product uy = Gy? is 
always nonnegative. In fact, it is always positive except at the origin point (0,0). 
Nonlinear passive resistive elements have nonlinear u~y curves lying in the first and 
third quadrants; examples are shown in Figures 6.2(a) and (b). Notice that the 
tunnel-diode characteristic of Figure 6.2(b) is still passive even though the curve 


oe 


Hem 


Figure 6.2(c) shows the. u-y characteristic of a negative resistance that was used 
in Section 1.2.4 to construct the negative resistance oscillator. Such characteristic 
can be only realized using active devices such as the twin tunnel-diode círcuit of 
Figure 1.7. For a multiport network where u and y are vectors, the power flow 
into the network is the inner product u7y = Xf. uiy: = XL. uihj(u). The network 
is passive if uTy > 0 for all u. This concept of passivity is now abstracted and 
assigned to any function y = h(t, u) irrespective of its physical origin. We think of 
uly as the power flow into the system and say that the system is passive if uTy 70 
for all u. For the scalar case, the graph of the input-output relation must lie in the 
first and third quadrants. We also say that the graph belongs to the sector [0, oo], 
where zero and infinity are the slopes of the boundaries of the first-third quadrant 
region. The graphical representation is valid even when h is time varying. In this 
case, the u-y curve will be changing with time, but will always belong to the sector 
[0, oo]. For a vector function, we can give a graphical representation in the special 
case when A(t, u) is decoupled in the sense that h(t, u) depends only on u;; that is, 


has negative slope in some region. As an example of an element that is not passive, ` 
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y y 
u u u 
(a) (b) (c) 


Figure 6.2: (a) and (b) are ex i 
2: amples of nonlinear passive resistor cha istics; (c) i 
an example of a nonpassive resistor. icu 


< 


hi(t, uy) 
ha(t, ug) 


: A(t, u) = (6.1) 


holt, up) 
In this case, the graph of each com 
: ponent belongs to the sector [0, oo]. In th 
iis n ee representation is not possible, but we a ae n a a 
r terminolo saying th i 
S EY y saying that A belongs to the sector [0, oo] if uT h(t,u) > 0 for 
Àn extreme case of passivity happens when uy = 0. In this case, we say that 


the system is lossless.. An example 
i of a lossl i i 
d M CS e ha Pub S ess system is the ideal transformer 


= uf ü 0 -N 
u-|. = = 
The matrix S is skew-symmetric; that is, § + ST 


(1/2)u7 (S + ST)u = 0. pc aa 


Figure 6.3: Ideal transformer 


Consider now a function h satisfy; 

satisfying uTy > uT 
When u? y(u) > 0 for all u #0, h is called fe 
Is strict in the sense that uy = 0 only if u 


(u) for some function y(u). 
nput strictly passive because passivity 
= 0. Equivalently, in the scalar case, 
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Figure 6.4: A graphical representation of uTy > eu™ for (a) € > 0 (excess of passiv- 
- ity); (b) € < 0 (shortage of passivity); (c) removal of excess or shortage of passivity by 
input-feedforward operation. 


the u-y graph does not touch the u-axis, except at the origin. The term uT y(u) 
represents the "excess" of passivity. On the other hand, if v" (u) is negative for 
some values of u, then the function h is not necessarily passive. The term uT y(u) 
represents the “shortage” of passivity. Excess and shortage of passivity are more 
transparent when / is scalar and y(u) = eu. In this case, h belongs to the sector 
[e, oo], shown in Figure 6.4, with excess of passivity when € > 0 and shortage of 
passivity when € < 0. Excess or shortage of passivity can be removed by the input- 
feedforward operation shown in Figure 6.4(c). With the new output defined as 
J = y — y(u), we have 


uT =u [y — plu)] > uT y(u) - vT e(u) 2 0 


Thus, any function satisfying uTy > u7y(u) can be transformed into a function that 
belongs to the sector [0, oo] via input feedforward. Such a function is called input- 
feedforward passive. On the other hand, suppose uTy > yTp(y) for some function 
p(y). Similar to the foregoing case, there is excess of passivity when yT p(y) > 0 for 
all y # 0, and shortage of passivity when y7 p(y) is negative for some values of y. 
A graphical representation of the scalar case with p(y) = dy is shown in Figure 6.5. 
There is "excess" of passivity when ó > 0 and shortage of passivity when ó « 0. 
Excess or shortage of passivity can be removed by the output-feedback operation 
shown in Figure 6.5(c). With the new input defined as à = u — p(y), we have 


ùy = [u — ply)? y 2 y ply) - y" (y) = 0 


Hence, any function satisfying uTy > yTp(y) can be transformed into a function 
that belongs to the sector [0,00] via output feedback. Such a function is called 
output-feedback passive. When yTp(y) > 0 for all y Æ 0, the function is called 
output strictly passive because passivity is strict in the sense that u7y = 0 only if 
y = 0. Equivalently, in the scalar case, the u-y graph does not touch the y-axis, 
except at the origin. For convenience, we summarize the various notions of passivity 
in the next definition. 
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(a) (b) (c) 


Figure 6.5: A graphical representation of u” y > óyT y for (a) 6 > 0 (excess of passiv- 
ity); (b) 6 < 0 (shortage of passivity); (c) removal of excess or shortage of passivity by 
output-feedback operation. 


Definition 6.1 The system y = A(t, u) is 
e passive if uTy > 0. 


e lossless if uTy = 0. 


input-feedforward passive if uT y > uT y(u) for some function p. 


input strictly passive if uy > uT y(u) and ut y(u) > 0, Vu #0. 


output-feedback passive if uT y > y™ p(y) for some function p. 


e output strictly passive if uT y > y! p(y) and y" p(y) > 0, V y #0. 
In all cases, the inequality should hold for all (t,u). 
Consider next a scalar function y = h(t, u), which satisfies the inequality 
au? € uh(t.u) < Bu? (6.2) 


for all (t, ú), where a and f are real numbers with £ > a. The graph of this function 
belongs to a sector whose boundaries are the lines y = au and y = fu. We say 
that h belongs to the sector |a, 8]. Figure 6.6 shows the sector [œ, 6] for 8 > 0 
and different signs of a. If strict inequality is satisfied on either side of (6.2), we 
say that A belongs to a sector (a, 8], (a, 8), or (a, 8), with obvious implications. 
Comparing the sectors of Figure 6.6 with those of Figures 6.4 and 6.5 shows that a 
function in the sector |a, 3] combines input-feedforward passivity with output strict 
passivity since the sector (a, 8] is the intersection of the sectors [a, oo] and [0, 6]. 
Indeed, we can show that such a function can be transformed into a function that 
belongs to the sector [0, oc] by a sequence of input-feedforward and output-feedback 
operations. Before we do that, we extend the sector definition to the vector case. 
Toward that end, note that (6.2) is equivalent to 


(A(t. u) — au][h(t. u) — Bu] € 0 | (6.3) 
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> Figure 6.6: The sector (a, 6] for @ > 0 and (a) a > 0; (b) a < 0. 
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for all (t,u). For the vector case, let us consider first a function h(t,u) that is 
decoupled as in (6.1). Suppose each component hi satisfies the sector condition 
(6.2) with constants a; and £i > ai. Taking 


-— 


Ki = diag(a1,@2,.--, ay). K2 = diag(fi, 85, . -» Bp) : 
it can be easily seen that 
[hlt u) - Kiu] h(t, u) — Kau] <0 (6.4) 


for all (t u). Note that K = Ka — K; is a positive definite symmetric (diagonal) 
matrix. Inequality (6.4) may hold for more general vector functions. For example, 
suppose h(t, u) satisfies the inequality 


h(t, u) - Lulla < vllulle 
for all (£,u). Taking Kı = L — yI and Kp = L +I, we can write 
[hlt u) — Kiuj (h(t, u) — Kaul = [[A(é, a) — Lull — "lull? < 0 
Once again, K = Kə — K; is a positive definite symmetric (diagonal) matrix. We 
use inequality (6.4) with a positive definite symmetric matrix K = K2 — Ky asa 


definition of the sector [K1, K2] in the vector case. The next definition summaries 
the sector terminology. 


Definition 6.2 A memoryless function h : [0, o0) x RP — RP is said to belong to 
the sector : 


e (0, oc] if v h(t,u) > 0. 
e [K5,o0] if uT[h(t, u) — Kyu] > 0. 
© [0, Ka] with Ky = KT > 0 if hT (t,u)[A(t,u) - Kou] < 0. 


Figure 6.7: A function in the sector [K1, K2), where K = K3 — Kı = KT > 0, can be 
transformed into a function in the sector [0, oo] by input feedforward followed by output 
feedback. 


* [K1, Ke] with K = Ko - K, = KT »0 if 
[h(t,u) — Kiu] [h(t, u) — Kou] < 0 (6.5) 


In all cases, the inequality should hold for all (t,u). If in any case the inequality is 
strict, we write the sector as (0,00), (K1,00), (0, K2), or (Ki, Ka). In the scalar 
case, we write (a, B), [a, B), or (e, B) to indicate that one or both sides of (6.2) is 
satisfied as a strict inequality. 


The sector [0, oo] corresponds to passivity. The sector [K1, oo] corresponds to input- 
feedforward passivity with y(u) = Ku. The sector [0, Ka] with Kz = (1/5)! > 0 
corresponds to output strict passivity with p(y) = dy. We leave it to the reader 
(Exercise 6.1) to verify that a function in the sector [K, K2] can be transformed into 
a function in the sector [0, oo] by input feedforward followed by output feedback, as 
shown in Figure 6.7. 


6.2 State Models 


Let us now define passivity for a dynamical system represented by the state model 


i 


f(z, v) (6.6) 
y = h(z,u) (6.7) 


where f : R” x RP — R” is locally Lipschitz. h : R” x RP — RP is continuous, 
f(0,0) = 0, and A(0,0) = 0. The system has the same number of inputs and 
outputs. The following RLC circuit motivates the definition. 


Example 6.1 The RLC circuit of Figure 6.8 features a voltage source connected 
to an RLC network with linear inductor and capacitor and nonlinear resistors. The 
nonlinear resistors 1 and 3 are represented by their v-i characteristics ij = hy (vi) 
and i3 = hs(vs), while resistor 2 is represented by its i-v characteristic v? = ha(ia). 


D 
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We take the voltage u as the input and the current y as the output. The product 
uy is the power flow into the network. Taking the current x; through the inductor 
and the voltage x2 across the capacitor as the state variables, we can write the state 
model as 


Li, = u- h(z1)— 12 
— ha(z2) 
y = zı+h(u) 


Q 
B 
i] 


The new feature of an RLC network over a resistive network is the presence of the 
energy-storing elements L and C. The system is passive if the energy absorbed by 
the network over any period of time [0, ¢] is greater than or equal to the increase in 
the energy stored in the network over the same period; that is, 


| "u(s)y(o) ds > V(z()) - V(z(0)) (6.8) 


where V(x) = (1/2)Lz1 + (1/2)C22 is the energy stored in network. If (6.8) holds 
with strict inequality, then the difference between the absorbed energy and the 
increase in the stored energy must be the energy dissipated in the resistors. Since 
(6.8) must hold for every t > 0, the instantaneous power inequality 


u(t)y(t) > V (t), u(t)) (6.9) 


must hold for all t; that is, the power flow into the network must be greater than or 
equal to the rate of change of the energy stored in the network. We can investigate 
inequality (6.9) by raktunting t the derivative of V along the trajectories of the 
system. We have 


V = Lat, +Crot, = milu- Aa(21) — 22] + zz[z1 — h3(z2)] 
= qilu ho(z1)] — zoha(z2) 

lei + hi (u)]u — uhi (u) — zi ha(21) — zoha(22) 

= uy—uh;(u) — ziha(zi1) — zahs(22) 


Thus, : 
uy = V + uhi(u) + riha(tı) + tahg(r2) 


If hi. ha. and Ag are passive. uy > V’ and the systein is passive. Other possibilities 
are illustrated by four different special cases of the network. 


Case 1: If hı = hz = hg = 0. uy = V and there is no energy dissipation in the 
network: due is, the system is lawless. 


Case 2: If ky and hy belong to the sector 10. x}. 


uy * V4 nhu) 
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Figure 6.8: RLC circuit of Example 6.1. 


The term uA, (u) could represent excess or shortage of passivity. If uh; (u) > 0 
for all u #0, there is excess of passivity since the energy absorbed over [0, ¢] 
will be greater than the increase in the stored energy, unless the input u(t) is 
identically zero. This is a case of input strict passivity. On the other hand, 
if uh; (u) is negative for some values of u, there is shortage of passivity. As 
we saw with memoryless functions. this type of excess or shortage of passivity 
can be removed by input feedforward shown in Figure 6.4(c). 


Case 3: If hy = 0 and Ag € (0, oc]. 
uy > V + yha(y) 


Excess or shortage of passivity of A? results in the same property for the 
network. Once again, as with memoryless functions, this type of excess or 
shortage of passivity can be removed by output feedback, as in Figure 6.5(c). 
When yha(y) > 0 for all y Æ 0. we have output strict passivity because the 
energy absorbed over [0,¢] will be greater than the increase in the stored 
energy, unless the output y(¢) is identically zero. 


Case 4: If hy € [0,00]. h2 € (0.2). and h3 € (0, 00), 
uy > V + zi ha(i) + zoha(22) 


where zi Ai (21) + xata (2) is a positive definite function of x. This is a case 
of state strict passivity because the energy absorbed over (0, t] will be greater 
than the increase in the stored energy, unless the state x(t) is identically 
zero. À system having this property is called state strictly passive or. simply. 
strictly passive. Clearly. there is no counterpart for state strict passivity in 
memoryless functions since there is no state. 
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Definition 6.3 The system (6.6)-(0.7) is said to be passive if there exists a contin- 
uously differentiable positive semidefinite function V (x) (called the storage function) 
such that av 

uly >V= a; 09 V (z,u) € R” x RP (6.10) 
Moreover, it is said to be 


e lossless if uT y =V. 


input-feedforward passive if uT y 2 V +uTp(u) for some function p. 


input strictly passive if uT y > V+uly(u) and ut y(u) > 0, Vu £0. 


e output-feedback passive if uTy > V ty aly) for some function p. 

e output strictly passive if uTy > V +y7 ply) and y? p(y) » 0, V y #0. 

e. strictly passive if uT y > V + v(x) for some positive definite function v. 
In all cases, the inequality Should hold for all (z,u). 


Definition 6.3 reads almost the same as Definition 6.1 for memoryless functions, 
except for the presence of a storage function V(x). If we adopt the convention 
that V(x) =0 for a memoryless function, Definition 6.3 can be used for both state 
models and memoryless functions. 


Example 6.2 The integrator of Figure 6.9(a), represented by 
i-u, y-cz 


is a lossless system since, with V(x) = (1/2)x? as the storage function, we have 
uy = V. When a memoryless function is connected in parallel with the integrator; 
as shown in Figure 6.9(b), the system is represented by 


sau | ysxth(u) 


Clearly, the system is input-feedforward passive since the parallel path h(u) can 
be cancelled by feedforward from the input. With V(x) = (1/2)z? as the storage 
function, we have uy = V --uh(u). If h € [0, oo], the system is passive. If uh(u) > 0 
for all u ¥ 0, the system is input strictly passive. When the loop is closed around an 
integrator with a memoryless function, as in Figure 6.9(c), the systein is represented 
by 

£=—hA(zr) +4, y-r 


Plainly, the system is output-feedback passive since the feedback path can be can- 
celled by a feedback from the output. With V(x) — (1/2)2? as the storage function, 
we have uy = V + yh(y). If ^ € [0,00], the system is passive. If yh(y) > 0 for all 
y #0, the system is output strictly passive. . A 


paa Sate ihe T b i We Pees ee 
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Figure 6.10: Example 6.3 


Example 6.3 The cascade connection i 
3T of an integrator and a passi 
function, shown in Figure 6.10(a), is represented by o E 


=u, y=hA(z) 


Passivity of h guarantees that Jo ^(c) do > 0 for all z. With V(x) = fy h(o) do 
2 the storage function, we have V = h(z)i = yu. Hence, the system it lossless. 
uppose now the integrator is replaced by the transfer function 1/(as + 1) with 


a > 0, as shown in Fi 
2 wn in Figure 6.10(b). The system caii be represented by the state 


at= ~-r +u, y = h(x) 
With V(z) =a to h(a) do as the storage function; we have 
V =A(z)(—2 + u) = yu ~ zh(z) € yu 


Hence, the system i i 
Samius ystem is passive. When xh(z) > 9 for ali z #0, the system is so 
6.3 Positive Real Transfer Functions 


Definition 6.4 A p x n j ; : 
Paie veal af p x p proper rational transfer function matriz G(s) is called 


* poles of all elements of G(s) are in Refs] < 0, 
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e for all real w for which jw is not a pole of any element of G(s), the matriz 
G(jw) + GT (—jw) is positive semidefinite, and 


e any pure imaginary pole jw of any element of G(s) is a simple pole and the 
residue matriz lim, .j,(s — jw)G(s) is positive semidefinite Hermitian. 


The transfer function G(s) is called strictly positive real! if G(s — €) is positive real 
for some e > 0. 


When p = 1, the second condition of Definition 6.4 reduces to Re[G(jw)] > 
0, Vw € R, which holds when the Nyquist plot of of G(jw) lies in the closed right- 
half complex plane. This is a condition that can be satisfied only if the relative 
degree of the transfer function is zero or one.? 

The next lemma gives an equivalent characterization of strictly positive real 
transfer functions. 


Lemma 6.1 Let G(s) be a p x p proper rational transfer function matriz, and 
suppose det [G(s) + GT (—s)] is not identically zero.” Then, G(s) is strictly positive 
real if and only if : 


e G(s) is Hurwitz; that is, poles of all elements of G(s) have negative real parts, 
e G(jw) + GT (—jw) is positive definite for allw € R, and 
e either G(oo) + GT (co) is positive definite or it is positive semidefinite and 
lim, os w MT [G(jw)+GT (—jw)]M is positive definite for any px (p—q) full- 
rank matriz M such that MT [G(oo) --GT (co)| M = 0, where q = rank[G(co) 4- 
GT (oo)]. 
Proof: See Appendix C.11. 


If G(oo) + GT(oo) = 0, we can take M = I. In the scalar case (p = 1), the 
frequency-domain condition of the lemma reduces to Re[G(jw)| > 0 for all w € R 
and either G(oo) > 0 or G(oo) = 0 and lim, cS w° Re[G(jw)] > 0. 


Example 6.4 The transfer function G(s) — 1/s is positive real since it has no 
poles in Re[s] > 0, has a simple pole at s = 0 whose residue is 1, and 


Re[G(jw)| = Re A =0, Yw#0 


1The definition of strictly positive real transfer functions is not uniform in the literature. (See 
[206] for various definitions and the relationship between them.) 

2 The relative degree of a ratlonal transfer function G(s) = n(s)/d(s) is deg d - deg n. For a 
proper transfer function, the relative degree is a nonnegative integer. 

A Equivalently, G(s) + GT (=a) has a normal rauk p over the fiekl af rational functions of «. 
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It is not strictly positive real since 1/(s — €) has a pole in Re[s] > 0 for any € > 0. 
The trausfer function G(s) = 1/(s -- a) with a > 0 is positive real, since it lias no 
poles in Re[s] > 0 and 


Re[G(j«)) = $5—3 »0, Vw €R 


a 
w? +a 
Since this is so for every a > 0. we sce that for any € € (0,a) the transfer function 
G(s — £) = 1/(s + a — £) will be positive real.’ Hence, G(s) = 1/(s + a) is strictly 
positive real. The same conclusion can he drawn from Lemma 6.1 by noting that 
2 


: 2 "D wa 
Jim w Re[G(ju)] = lim w? + a? 


=a>0 


The transfer function i 


G(s) = —5———— 

(s) sté+s+1 

is not positive real because its relative degroe is two. We can see it also by calculating 
1~w? 


Re|G(jw)] = ü-V ui 


«0, V|o| >1 


Consider the 2 x 2 transfer function matrix 


We cannot apply Lemma 6.1 because det[G(s) + GT (—s)] = 0 V s. However, G(s) 
is strictly positive real, as can be seen by checking the conditions of Definition 6.4. 
Note that, for € < 1, the poles of the elements of G(s — €) are in Re[s] < 0 and 


2(1— &) E d 


a(i- {1 1 


is positive semidefinite for all w € R. Similarly, it can be seen that the 2x 2 transfer 


function matrix . 
Gls) = 1 s 1 
Gm TI <i ek 


is strictly positive real. This time, however, det[G(s) + GT (—s)] is not identically 
zero, and we can apply Lemma 6.1 to arrive at the same conclusion by noting that 
G(oo) + GT (oo) is positive definite and 


G(jw — £) c G'(-je - £) = 


2 we -jw 
w+) | jw w+] 


is positive definite for all w € R. Finally. the 2 x 2 transfer function matrix 


G(ju) + G7 (-ju) = 


-$. 1 
sl 342 
G-| | , 
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ü G(o0)  G (oo) = | T | 


It can be verified that 
2w? —2jw 
1+w 4+u- | 


agas Gri | " 
tat Tet 


is positive definite for all w € R. Taking M T=[0 1], it can be verified that 
lim w?M? |G(jw) + GT (-ju)]M = 4 


Consequently, by Lemma 6.1, we conclude that G(s) is strictly positive real. A 


Passivity properties of positive real transfer functions can be shown by using the 
next two lemmas, which are known, respectively, as the positive real lemma and the 
Kalman- Yakubovich-Popov lemma. The lemmas give algebraic characterization of 
positive real and strictly positive real transfer functions. 


Lemma 6.2 (Positive Real) Let G(s) = C(sI — A)71B + D be a p x p transfer 
function matriz where (A, B) is controllable and (A,C) is observable. Then. G(s) 
is positive real if and only if there exist matrices P = PT » 0, L, and W such that 


PA- ATP zs -LTL (6.11) 
PB = CT-LUW (6.12) 
WTW = D+ DT (6.13) 


o 


Proof: See Appendix C.12. 


Lemma 6.3 (Kalman-Yakubovich-Popov) Let G(s) = C(s1— A) 3 B--D bea 
pxp transfer function matriz, where (A, B) is controllable and (A, C) is observable. 
Then, G(s) is strictly positive real if and only if there exist matrices P = PT » 0, 
L, and W, and a positive constant € such that 


PA4 ATP = —LTL-eP (6.14) 
PB = CT-LTW (6.15) 
wy = D4DT (6.16) 


o 
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Proof: Suppose there exist P = PT > 0, L 

= ,L,W,ande>Ot j 
through (6.16). Set p = ¢/2 and recall that G(s — ft) = C(sI - d E» 
From (6.14), we have Š MEUR 


P(A-t uI) - (A -- uI)TP = ~LTL (6.17) 


» rate sae donne em ace G(s — u) " positive real. Hence, G(s) is strictly 
: er hand, suppose G(s) is strictly positi i 
H > 0 such that G(s — u) is positive real. I AIEE dd P 
1 . It follows from Lemma 6.2 
are matrices P = PT > 0, L, and W, which sati Benn Ge 
ii L, . isfy (6.15) thr i 
€ = 2u shows that P, L, W, and e satisfy (6.14) through ut aaa 


D- 
Lemma 6.4 The linear time-invariant minimal realization 

$ = AÁr+ Bu 

y = Cr+ Du 


with G(s) = C(sf — A)-1B + D is 
* passive if G(s) is positive real; 
e. strictly passive if G(s) is strictly positive real. 


o 


Proof: Apply Locum 6 2 i 
poe e 2 and 6.3, respectively, and use V(s) = (1/2)z7 Pz as the 


r a 
uy a. (At + Bu) 


uT (Cz + Du) — zT P(Ax + Bu) 


T 
oon 3uT (D + Dyu — 1aT(PA + ATP)a — zT PBy 
= w (B P+WTL)e+ howl 
+ aT LT Lz + dex? Pr — aT PBu 
= i(Lz4 Wu) (Lz--Wu)-4 lez Pr > leg™ py 
In the case of Lemma 6.2, ¢ = ies 


0, and w i i 
ESD xad iata e conclude that the system is passive, while in 


and we conclude that the system is strictly passive. O 


6.4 Ly and Lyapunov Stability 


In thi i 
is section, we study C» and Lyapunov stability of passive systems of the form 


$ = f(z,u) : ` (6.18) 
y h(z,u) (6.19) 


where f : R” x RP — R* is locally Lipschi 
Ji 0pen dA DEG o UE ES 


is continuous, 
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Lemma 6.5 If the system (6.18)-(6.19) is output strictly passive with uTy > V + 
dy” y, for some 6 > 0, then it is finite-gain La stable and its La gain is less than or 
equal to 1/6. 


Proof: The derivative of the storage function V(z) satisfies 


AVS uly-ôyTy = chi e nra. la, 5 
S wy-óyy Div ôy) (u by) + zu u "AES 


1A 
g 
- 
ge 
I 
! 
e 
e 


integrating both sides over [0, 7] yields 


T 1 f, 
[ evo as % [iru a-ve- veo 
Thus, 
1 2 
Ives < sls + V 2V(@(0)) 


where we used the facts that V(x) > 0 and Va? +6? < a+b for nonuegative 
numbers a and b, n 


Lemma 6.6 If the system (6.18)-(6.19) is passive with a positive definite storage 
function V (z), then the origin of z = f(z, 0) is stable. 


Proof: Take V as a Lyapunov function candidate for  — f(z,0). Then V <0. n 


To show asymptotic stability of the origin of £ = f(x, 0), we need to either show 
that V is negative definite or apply the invariance principle. In the next lemma, we 
apply the invariance principle by considering a case where V = 0 when y = 0 and 
then require the additional property that 


y(t) =0 > z(t) =0 (6.20) 


for all solutions of (6.18) when u = 0. Equivalently, no solutions of $ = f(z,0) 
can stay identically in S = {x € R” | h(z,0) = 0}, other than the trivial solution 
x(t) = 0. The property (6.20) can be interpreted as an observability condition. 
. Recall that for the linear system 


$i-4z y=0r 
observability is equivalent to 
y(t) = Ce^'z(0) =0 & z(0) 20 & a(t) &0 


For easy reference, we define (6.20) ns an observability property of the system. 
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Definition 6.5 The system (6.18) (6.19) is said to be zero-state observable if no 
solution of t = f(r.0) can stay identically in S = {x € R” | h(z,0) = 0), other 
than. the trivial solution x(t) = 0. 


Lemma 6.7 Consider the system (6.18)-(6.19). The origin of $ = f(x,0) is 
asymptotically stable if the system is 


e strictly passive or 
e output strictly passive and zero-state observable. 


Furthermore, if the storage function is radially unbounded, the origin will be globally 
asymptotically stable. o 


Proof: Suppose the system is strictly passive and let V (z) be its storage function. 
Then, with u = 0. V satisfies the inequality V < —y(z), where v(z) is positive 
definite. We can use this inequality to show that V(x) is positive definite. In 
particular, for any x € R”, the equation £ = f(z,0) has a solution o(t:z), starting 
from z at t = 0 and defined on some interval [0,6]. Integrating the inequality 
V <-v(z) yields 


e 


V(o(r.2)) - V(z) < - í " Melt) dt, Vr € [0.6] 


Using V(ó(r. z)) > 0, we obtain 


Vir) > ji " bløtt: x) at 


Suppose now that there is Z # 0 such that V(z) = 0. The foregoing inequality 
implies 


[ «eco dt =0, V7 € [0.6] > v(ó(t;z)) &0 > ó(:2) 80 > 2-0 
0 


which contradicts the claim that Z 4 0. Thus, V(x) > 0 for all z # 0. This qualifies 
V(x) as a Lyapunov function candidate. and since V(x) € —V(r), we conclude that 
the origin is asymptotically stable. 

Suppose now tlie system is output strictly passive and let V(x) be its storage 
function. Then, with u = 0, V satisfies the inequality V < —yT p(y), where y7 p(y) > 
0 for all y £ 0. By repeating the preceding argument, we can use the inequality to 
show that V (z) is positive definite. In particular, for any z € R^, we have 


vie f "AT (6(t:2), 0)o(A(O(t;2),0)) dt 
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Suppose now that there is Z # 0 such that V(z) = 0. The foregoing inequality 
implies : 


T hT (e(t; x), 0)p(h(ó(t; Z), 0)) dt=0, Vre 0,6) > A(t; z),0) =0 
0 : 


which, due to zero-state observability, implies 
o(t;2)=0 > F=0 


Hence, V(z) > 0 for all z # 0. This qualifies V(z) asa Lyapunov ae 
‘didate, and since V(x) < —yT ply) and y(t) = 0 > m EN x v 
the invariance principle that the origin is asymptotically sta e. Finally, i x is 
radially unbounded, we can infer global asymptotic stability from Theorem 4. 


ü 
Corollary 4.2, respectively. 
Example 6.5 Consider the p-input-p-output system? 
£ = f(z)+G(a)u 
y = A(z) 
i ipschitz, i 0) = 0, and ^(0) = 0. 
s locally Lipschitz, G and h are continuous, f (0 0, l ) 
dk ie ate continuously differentiable positive semidefinite function V (a) 
such that 
8V av =A (2 
./G6) $0, GeO =h) 
Then, 
BV 
V V _ pt a Y fezo 
uty — D (f(a) + Glej = ha) - IO e — n f 


which shows that the system is passive. If V (x) is positive definite, we can conclude 
that the origin of z = f(x) is stable. If we have the stronger condition 
av 


ð 
OY f(a) < -kT (ahta), PK afa) = h(a) 


for some k > 0, then 
uTy — 3» V? + G(z)u] 2 ky y 


and the system is output strictly passive with p(y) — ky. It follows from spes vn 
that the system is finite-gain £2 stable and its £2 gain is less than or equal , : 
If, in addition, the system is zero-state observable, then the origin of ż = f(z z 
asymptotically stable. Furthermore, if V(z) is radially unbounded, the origin A 
be globally asymptotically stable. 


1/5 stability of this system was studied in Examples 5.9 and 5.10. 
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Example 6.6 Consider the single-input single-output system? 


I1 = I2 


lí 


Le az? ~- kr + u 


y = zx 


where a and k are positive constants. Consider also the positive definite, radially 
unbounded function V(x) = (1/4)azj + (1/2)z2 as a storage function candidate. 
The derivative V is given by 


V = azjz;  zi(—az] ~ kx + u) = -ky? + yu 
Therefore, the system is output strictly passive with p(y) = ky. It follows from 
Lemma. 6.5 that the system is finite-gain £2 stable with £2 gain less than or equal 
to 1/k. Moreover, when u = 0, 
y(t) 80 => 29(t)=0 => azj(t) &0 s 2, (t) =0 

Hence, the system is zero-state observable. It follows from Lemma 6.7 that the 
origin of the unforced system is globally asymptotically stable. A 
6.5 Feedback Systems: Passivity Theorems 

Consider the feedback connection of Figure 6.11 where each of the feedback com- 


ponents H and H3 is either a time-invariant dynamical system represented by the 
state model . 


li 


d, 
Vi 


Silti ei) (6.21) 
hi(zi, ei) (6.22) 


or a (possibly time-varying) memoryless function represented by 
yi = hi(t ei) (6.23) 


We are interested in using passivity properties of the feedback components H; and 
Hs» to analyze stability of the feedback connection. We will study both £2 and 
Lyapunov stability. We require the feedback connection to have a well-defined state 
model. When both components H, and H3 are dynamical systems, the closed-loop 
state model takes the form 


i = fimu) (6.24) 


RICO a ees - 
50» and Lyapunov stability of this system were studied in Examples 5.8 and 4.9. 
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Figure 6.11: Feedback connection. 
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We assume that f is locally Lipschitz, h is continuous, f(0,0) = 0, and A(0,0) = 0. 
It can be easily verified that the feedback connection will have a well-defined state 
model if the equations i 


where 


e = w — hia(z2,e2) (6.26) 
ez uz + hi(z1,01) (6.27) 


have a unique solution (ei, e2) for every (21,22, u;,u2). The properties f(0,0) = 0 
and h(0,0) = 0 follow from f;(0,0) = 0 and ^,(0,0) = 0. It is also Rs i see 
that (6.26) and (6.27) will always have a unique solution if h; is independent of 2 
or ha is independent. of e2. In this case, the functions f and A of the closed-loop 
state model inherit smoothness properties of the functions f; and h; of the feedback 
components. In particular, if f; and ^; are locally Lipschitz, so are f and h. For 
linear systems, requiring hy to be independent of e, is equivalent to requiring the 
transfer function of H; to be strictly proper.® 

When one component, H, say, is a dynamical system, while the other one is a 
memoryless function, the closed-loop state model takes the form 


F(t, 2,u) (6.28) 
A(t, zu) (6.29) 


= =| a yı 
T2, = = 
1, u pee and y il 


We assume that f is piecewise continuous in ¢ and locally Lipschitz in (z, 
piecewise continuous in t and continuous in (z, u), f(t,0,0) = 0, and A(t,0, 


where 


ei 


——— le T 
6 H 
"The existence of solutions for (6.26) and (6.27) is pursued further in Exercise 6.12. 
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The feedback connection will have a well-defined state model if the equations 


e& = Un holt, e2) (6.30) 
ug + hi(zi,e1) (6.31) 


€2 


have a unique solution (€1,€2) for every (r1,t, uj, ug). This will be always the case 
when kı is independent of ej. The case when both components are memoryless 
functions is less important and follows trivially as a special case when the state x 
does not exist. In this case, the feedback connection is represented by y = A(t, u). 


The starting point of our analysis is the following fundamental property: 
Theorem 6.1 The feedback connection of two passive systems is passive. 


Proof: Let Vi (z1) and V2(z2) be the storage functions for H, and H2, respectively. 
If either component is a memoryless function, take V; = 0. Then, 


ef y; > Vi 


From the feedback connection of Figure 6.11, we see that 


ely, tet y; = (ur — y) n + (uz i) ye = UT + ie 


Hence, T 7 
uly = uL yi t uda 2 Vi + Ve 


Taking V (z) = Vi (£1) + Vo(z2) as the storage function for the feedback connection, 


we obtain . 
uTy 2 V 


im) 
Using Theorem 6.1 and the results of the previous section on stability properties 
of passive systems, we can arrive at some straightforward conclusions on stability 


of the feedback connection. We start with Lə stability. The next lemma is an 
immediate consequence of Lemma 6.5. 


Lemma 6.8 The feedback connection of two output strictly passive systems with 
elyi > Vitóyiy, 50 


is finite-gain L stable and its L2 gain is less than or equal to 1/ min(;, 52}. 


Proof: With V = V, + V; and 6 = niin{6,, 62}, we have 


> VeéuTy gy) =V +ôy y 


uTy ely +elys > Vit Óy n + Va t ô2y3 y2 


PR ER ARRAS 


ce 
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das thor: 


eee 


p 


4 1 Tg " a. “te - $ 
248 - CHAPTER 6. PASSIVITY 
[m] 
Reading the proof of Lemma 6.5 shows that we use the inequality 
uly > Y + dy7y (6.32) 
to arrive at the inequality i P 
V< au - PUE] (6.33) 


which is then used to show finite-gain £2 stability. In Lemma 6.8, we inr 
(6.32) for the feedback connection, which then leads to (6.33). However, even i 
(6.32) does uot hold for the feedback connection, we may still be able to show an 
inequality of the form (6.33). This idea is used in the next theorem to prove & more 
general result that includes Lemma 6.8 as a special case. 


Theorem 6.2 Consider the feedback connection of Figure 6.11 and suppose each 
feedback component satisfies the inequality 


ef y; 2 Vi t eie ei + diy? yi, fori 1,2 (6.34) 


for some storage function Vi(z;). Then, the closed-loop map from u to y is finite 
ain Lo stable if ; 
: £102 5 0 and 6&2 401 5 0 (6.35) 


o 


Proof: Adding inequalities (6.34) for i — 1,2 and using 


T 
enter = uy tui 
efe = ulus = Qui yo + yi yo 
T T T T 

eze9 = uzu: +2uzy ty 

we obtain i ^ 
Y« -y7 L) uT Mu +u” Ny 

where ' 


: I 2&1 
(£2 + 63)I 0 of &l 0 N= | 1 | 
i= 0 (& 42) J’ iN E el I 


and V(z) = Vi(z1) + Vo(z2). Let a = min(ea + 61,€1 + 62} > 0, b = ||N|l2 > 0, and 
c= ||Mll2 z 0. Then 
V < -alyli2 + dijuflallylle + celuli 


, b a 
= - zz (blull — allyl}? + ELLE = zvl + cliul 


EL. Gu ae 
< a; Melle - z lvli 


—— EE kr s 
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where k? = 5? + 2ac. Integrating over (0, r], using V(x) > 0, and taking the square 
roots, we arrive at 


leds < 5l, + VVO 


which completes the proof of the theorem. n 


` Theorem 6.2 reduces to Lemma 6.8 when (6.34) is satisfied with £1 = £2 = 0, 
6, > 0, and 52 > 0. However, condition (6.35) is satisfied in several other cases. 
For example, it is satisfied when both H; and H3 are input strictly passive with 
ei yi > Vi-ejuT u for some e; > 0. It is also satisfied when one component (Hj say) 
is passive, while the other component satisfies (6.34) with positive e and 62. What 
is more interesting is that (6.35) can be satisfied even when some of the constants 
c; and 6; are negative. For example, a negative & can be compensated for by a 
positive 62. This is a case where shortage of passivity (at the input side) of Hj 
is compensated for by excess of passivity (at the output side) of H3. Similarly, a 
negative 62 can be compensated for by a positive e1. This is a case where shortage 


of passivity (at the output side) of Hz is compensated for by excess of passivity (at 
the input side) of H}. 


Example 6.7 Consider the feedback connection of 


5 Jt = f(z) +G(z) 
Hy: s 5 dun 7 l and Hy 


where k > 0 and ej, y; € RP. Suppose there is a positive definite function Vi(z) 
such that 


ya = keg 


vi OV; T 
M , < IM = n 
Ae (z) <0, Dz G(z)=h*(z), VzeR 
Both components are passive. Moreover, Hp satisfies 


l- 
e yo = kef ez = kel ez + Orgy, -0<7<1 


Thus, (6.34) is satisfied with &j = 6, = 0, £2 = yk, and & = (1— 4)/k. This shows 
that.(6.35) is satisfied, and we conclude that the closed-loop map from u to y is 
finite-gain £5 stable. A 


Example 6.8 Consider the feedback connection of 


ii = 2 
Hı $2 = -—azl-oc(z;j)cte and Ho: y= kez 
Yo = x 


where ø € [—a, oo], a > 0, a > 0, and k > 0. If o was in the sector [0, co], we could 
have shown that Hj is passive with the storage function V, (z) = (a/4)x} + (1/2)22. 
For ø € [—a, co], we have 


VY, = azijza — orjza — T20(12) + 2261 X ax} + ze; = ay? + ye, 


a 
E 
i 
H 
; 
E 
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Hence, (6.34) is satisfied for H, with e = 0 and 6, = —a. Since 


1-4). 
e2y2 = kez = yk} + og, 0«4«1 

(6.34) is satisfied for H2 with e3 = yk and 62 = (1— 3)/k. If k > a, we can choose 

y such that yk > o. Then, £4 + 6 > 0 and £2 +6, > 0. We conclude that the 

closed-loop map from u to y is finite-gain £2 stable. A 


Let us turn now to studying Lyapunov stability of the feedback connection. We 
are interested in studying stability and asymptotic stability of the origin of the 
closed-loop system when the input u = 0. Stability of the origin follows trivially 
from Theorem 6.1 and Lemma 6.6. Therefore, we focus our attention on studying 


asymptotic stability. The next theorem is an iminediate consequence of Theorem 6.1 
and Lemma 6.7. 


Theorem 6.3 Consider the feedback connection of two time-invariant dynamical 
systems of the form (6.21)-(6.22). The origin of the closed-loop system (6.24) (when 
u = 0) is asymptotically stable if 


* both feedback components are strictly passive, 


* both feedback components are output strictly passive and zero-state observable, 
or 


* one component is strictly passive and the other one is output strictly passive 
and zero-state obscrvable. 


Furthermore, if the storage function for each component is radially unbounded. the 
origin is globally asymptotically stable. © 


Proof: Let V; (21) and Vo(z2) be the storage functions for H, and Ho, respectively. 
As in the proof of Lemma 6.7, wé can show that Vi(z1) and Vo(z2) are positive 
definite functions. Take V(r) = V (z1) + Vo(z2) as a Lyapunov function candidate 
for the closed-loop system. In the first case, the derivative V satisfies 


V < uly — Ja (71) — Yo(z2) = — (21) — do(z2) 
since u = 0. Hence, the origin is asymptotically stable. In the second case, 
V € -y Ev) — v1 ps (va) 


where yf pi(yi) > 0 for all y; # 0. Here V is only negative semidefinite and V = 0 = 
y = 0. To apply the invariance principle, we need to show that y(t) = 0 = z(t) =0. 
Note that yo(f) = 0 = e(t) = 0. Then, zero-state observability of H, shows 
that y(t) = 0 = z(t) = 0. Similarly, y(t) = 0 = ez(t) = 0 and zero- 
state observability of Ha shows that y2(t) =0 = z2(t) = 0. Thus, the origin is 
asymptotically stable. In the third case (with H; as the strictly passive component), 


V € =u (21) - uF plua) 


wu ce E 
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and V = 0 implies zı = 0 and y; = 0. Note that yo(t) =0 = e(t) =0, which 
together with z(t) = 0 imply that y;(f) = 0. Hence, eg(t) = 0 and zero-state 
observability of Hz shows that y2(t) =0 = z2(t) =0. Thus, the origin is asymp- 
totically stable. Finally, if V; (zj) and V2(z2) are radially unbounded, so is V(z), 
and we can conclude global asymptotic stability. D 


The proof uses a simple idea, namely, that the sum of the storage functions 
for the feedback components is used as a Lyapunov function candidate for the 
feedback connection. Beyond this simple idea, the rest of the proof is straightfor- 
ward Lyapunov analysis. In fact, the analysis is restrictive because to show that 
V=V,+ Vo € 0, we insist that both Vi < 0:and V, < 0. Clearly, this is not 
necessary. One term, Vi say, could be positive over some region as long as the sum 
V <0 over the same region. This is again a manifestation of the idea that shortage 
of passivity of one component can be compensated for by excess of passivity of the 
other component. This idea is exploited in Examples 6.10 and 6.11, while Example 
6.9 is a straightforward application of Theorem 6.3. 


Example 6.9 Consider the feedback connection of 


ii = T2 x3 = T4 " 
Hi: ¢ (49 = —ar}—kro+e and Ha: dq = —br3-— Xj 63 
Y= £2 y2 = X4 


where a, b, and k are positive constants. Using Vi = (a/4)z] + (1/2)23 as the 
storage function for Hj, we obtain 


V, = azjza — arjra - kr} + r261 = -ky? + yer 
Hence, Hi is output strictly passive. Besides, with e = 0, we have 


0 


y(t) 80  m(t)=0 > z(t) 


which shows that H. i is zero-state observable. Using V2 = (b/2)22 + (1/2)22 as the 
storage function for H2, we obtain 


Vo = braza — brary — T$ + z4€2 = —y2 + ya€2 
Therefore, H3 is output strictly passive. Moreover, with e2 = 0, we have 
yo(t) 80 & z,(f) 80 > za(t) =0 


which shows that H2 is zero-state observable. Thus, by the second case of Theo- 
rem 6.3 and the fact that Vj and Vz are radially unbounded, we conclude that the 
origin is globally asymptotically stable. A 
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Example 6.10 Reconsider the feedback connection of the previous example, but 
change the output of Hi to y; = za + e1. From the expression 


V, = —kzl + m6, = -k(yi — 61) ~ ef tne 


we can conclude that H, is passive, but we cannot conclude strict passivity or 
output strict passivity. Therefore, we cannot apply Theorem 6.3. Using 


V =V, +V = taxi + br + {br + 327° 
as a Lyapunov function candidate for the closed-loop system, we obtain 


V = —kz2 + T261 — aj + T462 
—kzl— z9z4 — 24  t4(72 — T4) 
-kr -zj - r} € 0 


Moreover, V = 0 implies that z2 = zy = 0 and 
zalt) 80 => azi(t) - ralt)=0 > a(t) =0 
zalt) =O = —br3(t) + za(t)=0 = z3(t)=0 


Thus, by the invariance principle and the fact that V is radially unbounded, we 
conclude that the origin is globally asymptotically stable. A 


| Figure 6.12: Example 6.11. 


When the feedback connection has a dynamical system as one component and 
a memoryless function as the other component, we can perform Lyapunov analysis 
by using the Storage function of the dynamical system as a Lyapunov function 
candidate, It is important, however, to distinguish between time-invariant and 
time-varying memoryless functions, for in the latter case the closed-loop system 
will be nonautonomous and we cannot apply the invariance principle as we did in 


the proof of Theorem 6.3. We treat these two cases separately in the next two 
theorems. 


Example 6.11 Reconsider the system 


ii = T2 
—hi(zi) — ha(z2) 


from Examples 4.8 and 4.9, where h; and hy are locally Lipschitz and belong to 
the sector (0,00). The system can be viewed as the state model of the feedback 
connection of Figure 6.12, where H, consists of a negative feedback loop around the 
integrator £2 with hz in the feedback path, and H2 consists of a cascade connection 
of the integrator zı with hy. We saw in Example 6.2 that H, is output strictly 
passive with the storage function V; = (1/2)<3 and, in Example 6.3, that Ho is 
lossless with the storage function Vz = fo‘ hi(o) do. We cannot apply Theorem 6.3 
because Hp is neither strictly passive nor output strictly passive. However, using 
V = V; + Va = fo! hi(o) do + (1/2)23 as a Lyapunov function candidate, we can 
proceed to investigate asymptotic stability of the origin. This is already done in 
Examples 4.8 and 4.9, where it is shown that the origin is asymptotically stable and 
will be globally asymptotically stable if T hi(z) di — ooas|y| — oo. We will 
not repeat the analysis of these two examples here, but let us note that if hı (y) and 
ha(y) belong to the sector (0,00) only for y € (~a, a), then the Lyapunov analysis 
can be limited to some region around the origin, leading to a local asymptotic 
stability conclusion, as in Example 4.8. This shows that passivity remains useful as 
a tool for Lyapunov analysis even when it holds only on a finite region, rather than 
the whole space. ‘A 


12 


Theorem 6.4 Consider the feedback connection of a strictly passive, time-invariant 
dynamical system of the form (6.21)-(6.22) with a passive (possibly time-varying) 
memoryless function of the form (6.23). Then, the origin of the closed-loop system 
(6.28) (when u = 0) is uniformly asymptotically stable. Furthermore, if the storage 
function for the dynamical system is radially unbounded, the origin will be globally 
uniformly asymptotically stable. o 


Üü 


EMO KUSKATA NA ATEA Rea A a NETURI ge Se 


Proof: As in the proof of Lemma 6.7, it can be shown that Vi (21) is positive 
definite. Its derivative is given by l 


„av " 
Y= 5; ^ Cie) S eii — Vi (zi) = ~eF yo — Yi (21) € -p (21) 
The conclusion follows from Theorem 4.9. f o 


Theorem.6.5 Consider the feedback connection of a time-invariant dynamical sys- 
tem Hy of the form (6.21)-(6.22) with a time-invariant memoryless function Ha of 
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the form (6.23). Suppose that H, i 
1 7$ zero-state observable and h siti i 
storage function, which satisfies d i 


T ; 
ein 2 Vi t+ yt p(y) ; (6.36) 

and that Ho satisfies 
e ya 2 ed va (en) (6.37) 


Then, the origi . . 
Mae origin of the closed-loop system (6.28) (when u = 0) is asymptotically 


v7 [ai(v) + yo(v)] >0, Yvo (6.38) 

Furthermore, if V, i i TP 
has ore, if Vy is radially unbounded, the origin will be globally asymptotically 
o 


Proof: Use Vj(zi) asa Lyapunov function candidate, to obtain 


4 an 
Y= Bg, e) S ely -y (n) 


ES EE, 
ey- Vin) S - y es) + yT ply) 


Inequality (6.38) shows that YA € 0 end W-0 >y = 0. Noting that yi(t) = 
0-2 ext) =0 > e(t) = 0, we see that zero-state observability of H; implies that 
Z(t) =0. The conclusion follows from the invariance principle. Oo 


cae 6.12 Consider the feedback connection of a strictly positive real transfer 
oe and a passive time-varying memoryless function. From Lemuna 6.4, we 
sait that the dynamicel system is strictly passive with a positive definite storage 
e Ree a sa a V(x) = (1/2)z7 Pz. From Theorem 6.4, we conclude that the 
Ciosed-loop system is globally uniformly asymptotically stabl is i 
a version of the circle criterion of Section 7.1. . TER ird TR 


Example 6.13 Consider the feedback connection of 


jus { i f(z) + G(z)a 
uv 


h(x) and He: y=a(eo) 
where ø € (0,00) and ei, y, € RP, Su is a radi 
€ : . Suppose there is diall itiv 
definite function V; (z) such that EXC a D 
avs ov 
Ox Or 


& 1 IS State ooser abl " Both . 
nd H zero-stal b erv: e components are passive. Moreover H5 


(z) <0, ()-2h^'(z, Vre R" 


ej ya = ejc (e2) 


Thus, (6.36) is satisfied with p1 = 0, and (6.37) is satisfied with yo = c. Since 
c € (0,00), (6.38) is satisfied. It follows from Theorem 6.5 that the origin of the 
closed-loop system is globally asvinptotically stable. A 
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We conclude this section by presenting loop transformations, which extend the 
utility of passivity theorems. Starting with a feedback connection in which one of the 
two feedback components is not passive or does not satisfy a condition that is needed 
in one of the theorems, we may be able to reconfigure the feedback connection 
into an equivalent connection that has the desired properties. We illustrate the 
process first for loop transformations that use constant gains. Suppose Hi is a 
time-invariant dynamical system, while H is a (possibly time-varying) memoryless 
function that belongs to the sector [K,, K2], where K = Kz — K; is a positive 
definite symmetric matrix. We saw in Section 6.1 that a function in the sector 
[K,, K2] can be transformed into a function in the sector (0, co] by input feedforward 
followed by output feedback, as shown in Figure 6.7. Input feedforward on Hz 
can be nullified by output feedback on Hj, as shown in Figure 6.13(b), resulting 
in an equivalent feedback connection, as far as asymptotic stability of the origin 
is concerned. Similarly, premultiplying the modified H2 by K^! can be nullified 
by postmultiplying the modified H; by K, as shown in Figure 6.13(c). Finally, 
output feedback on the component in the feedback path can be nullified by input 
feedforward on the component in the forward path, as shown in Figure 6.13(d). 
The reconfigured feedback connection has two components H, and Hz, where H 
is a memoryless function that belongs to the sector [0,00]. We can now apply 
Theorem 6.4 or 6.5 if Hi satisfies the conditions of the respective theorem. 


Example 6.14 Consider the feedback connection of 
ii 

Hi : tz 

yı 


where c € (o, £], ^ € [a1,00], b > 0, aı > 0, and k = 8 — a > 0. Applying the loop 
transformation of Figure 6.13(d) (with A, = a and K2 = £) results in the feedback 
connection of 


T2 
—h(zi) + bx2 t € and Ha: y2=a(e) 
r2 


~ tı m -~ 
Hı: Xo —h(zi) — ar + ĉi and H: y= G(é2) 
fio = kagt+é 


1 


where & € |0, oo] and a = a — b. If a > b, it can be shown (Exercise 6.4) that Hi 
is strictly passive with a storage function of the form V; = k fj h(s) ds + zT Pz, 
where P = PT > 0. Thus, we conclude from Theorem 6.4 that the origin of the 
feedback connection is globally asymptotically stable. A 


Next. we consider loop transformations with dynamic multipliers, as shown in 
Figure 6.14. Premultiplying Hz by a transfer function W(s) can by nullified by 
postmultiplying Hı by W 71(s), provided the inverse exists. For example, when Hz 
is a passive, time-invariant, memoryless function h, we saw in Example 6.3 that 
premultiplying h by the transfer function 1/(as + 1) results in a strictly passive 


XQ 


Figure 6.13: Loop transformation with constant gains. A memoryless function He in 
the sector [K1, K2] is transformed into a memoryless function Hg in the sector [0, oo]. 


ec LÀ 


Figure 6.14: Loop transformation with dynamic multipliers. 


dynamical system. If postmultiplying H, by (as + 1) results in a strictly passive 
system or an output strictly passive system that is zero-state observable, we can 
employ Theorem 6.3 to conclude asymptotic stability of the origin. This idea is 
illustrated in the, next two examples for cases where H is linear and nonlinear, 
respectively. 


Example 6.15 Let H, be a linear time-invariant system represented by the state 
model 


t= Ar + Be}, y=Czx 


where 
0 1 0| i 
a=[ 4 zs 5-1] and C=[1 0] 


Its transfer function 1/(s? + s + 1) has relative degree two; hence, it is not positive 
real. Postmultiplying H, by (as-- 1) results in H1, which can be represented by the 
state model 

$-ArtBe, d -Óxs 


where C =C+aCA=[1 a ]. Its transfer function (as + 1)/(s? + s + 1) satisfies 
the condition 


1+jwa ]  1-(a-1)5? 
Re [a] ~ (1—w)? +02 TC NER 
ifa > 1. Thus, choosing a > 1, we can apply Lemmas 6.3 and 6.4 to conclude that 
Hj is strictly passive with the storage function (1/2)z7 Pz where P satisfies the 
equations 


PA+A?P=-L'’L-eP, PB=CT 
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: for some L and £ > 0. On the other hand. let H2 be given by y; = h(e2). where 


h € [0, co]. We saw in Example 6.3 that premultiplying h by the transfer function 
1/(as+1) results in a strictly passive system with the storage function a Jo h(s) ds. 
Application of Theorem 6.3 shows that the origin of the transformed feedback con- 
nection of Figure 6.14(b) (with zero input) is asymptotically stable with the Lya- 
punov function V = (1/2)27 Px + a f? h(s) ds. Notice, however, that the trans- 
formed feedback connection of Figure 6.14(b) has a state model of dimension three, 
while the original feedback connection has a state model of dimension two; so more 
work is needed to establish asymptotic stability of the origin of the original feedback 
connection. The extra work can be alleviated if we use the transformed feedback 
connection only to come up with the Lyapunov function V and then proceed to 
calculate the derivative of V with respect to the original feedback connection. Such 
derivative is given bv 


V = dc? Pi + 47 Pr + ah(er)é2 
$27 P[Ax — Bh(e2)] + 1[Az — Bh(ez)|7 Px + ah(eg)C|Az — Bh(ez)] 
- da? LT La ~ (£/2)zT Px — zT CT h(e3) + ah(e2)CAr | 
— 427 LT La — (e/2)x7 Px ~ zT [C --'aC A] h(eg) + ah(eg)C Ax 
= ~ $27 LT La —(e/2)27 Px —-efh(ey) € -(e/2)r" Px 


which shows that the origin is asymptotically stable. In fact, since V is radially 
unbounded, we conclude that the origin is globally asymptotically stable. A 


Example 6.16 Consider the feedback connection of 


ii 
Hi H i2 
u 


where b > 0, k > 0, and h € [0,00]. Postmultiplying H, by (as + 1) results 
in a system H, represented by the same state equation but with a new output 
ğı = 21 +az2. Using V, = (1/4)ba} + (1/2)zT Px as a storage function candidate 
for H,, we obtain 


T2 
-bx)- kra +61 and Hy: y2 = h(ez) 
Ti 


Vy = b(1 ~ poa)a3ce — piabzi + (pizi + Pizza) a2 
— (p1221 + p2212)kT2 + (pie + pa212)ei 


Taking pi, = k, p12 = pz = 1, a = 1, and assuming that k > 1, we obtain 
| V, = —br} - (k-1)25 + hes 


which shows that Zi, is strictly passive. On the other hand, premultiplying h by 
the transfer function 1/(s + 1) results in a strictly passive system with the stor- 
age function h ? (s) ds, Using the storage function (of the transformed feedback 
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connection) ^ 
V = (1/4)0z1 + (1/2)27 Pr + | h(s) ds 
0 


as a Lyapunov function candidate for the original feedback connection (when u = 0) 


yields i 


bzjrg + (kzı + z2)z2 + (zi + z2)[-br] — kre — h(e2)] + h(e2})22 
—(k — 1)z2 — br} — zih(z1) 


V 


which is negative definite. Since V is positive definite and radially unbounded, we 
conclude that the origin is globally asymptotically stable. A 


6.6 Exercises 


6.1 Verify thaf a function in the sector [K 1, K2] can be transformed into a function 
in the sector [0, oc] by input feedforward followed by output feedback, as shown in 
Figure 6.7. | 


6.2 Consider the system 
aż = -xr + ih) Tu, y = h(x) 


where a and k are positive constants and A € [0, k]. Show that the system is passive 
with V(z) = a fj h(c) do as the storage function. ` 
6.3 Consider the system 

tı = T2, dq = —h(x1) — ara + u, y=ar, +22 


where 0 < a <a and h € (0, oc]. Show that the system is strictly passive. 
Hint: Use V(r) of Example 4.5 as the storage function. 


6.4 Consider the system 
Z)=22, da2--h(r)-ax2*tu y=krtu 


where a > 0, k > 0, h € [o1, 20] and a; > 0. Let V(x) = k fy’ h(s) ds 4 zTPz, 
where pii = Gpiz. P22 = k/2. and 0 < pi2 < min (201, ak/2}. Using V(x) as a 
storage function, show that the systein is strictly passive. 


6.5 Consider the system represented by the block diagram of Figure 6.15, where 
u,y € RP, M and K are positive definite symmetric matrices, he (0, K], and 
hT(c)M do > 0 for all z. Show that the system is output strictly passive. 
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y 
“j (MsK)! — 


Figure 6.15: Exercise 6.5 


6.6 Show that the parallel connection of two passive (respectively, input strictly 
passive, output strictly passive, strictly passive) dynamical systems is passive (re- 
spectively, input strictly passive, output strictly passive, strictly passive). 


6.7 Show that the transfer function (bos + b1)/(s? + ais + a2) is strictly positive 
real if and only if all coefficients are positive and bı < a1bo. 


6.8 Consider equations (6.14) through (6.16) and suppose that (D + DT) is non- 
singular. Show that P satisfies the Riccati equation 


PAo + ALP - PBP + Cy = 0 


where Ag = —(c/2) — A + B(D  DT)71C, By = B(D + DT)-3 BT, and Oo = 
-CT(D+DT)-!¢. 


6.9 Show that if a system is input strictly passive, with y(u) = eu, and finite-gain 


£3 stable, then there is a storage function V and positive constants e; and 6, such | 


that 
uly >V+eutut ôy y 


6.10 Consider the equations of motion of an m-link robot, described in Exer- 
cise 1.4. Assume that P(q) is.a positive definite function of q and g(q) = 0 has an 
isolated root at q = 0. 3 
(a) Using the total energy V = 347 M(g)j + P(g) as a storage function, show that 

the map from u to q is passive. 

(b) With u = —Ka4 + v, where Kg is a positive diagonal constant matrix, show 

that the map from v to q is oltput strictly passive. 

(c) Show that u = —Kaġ, where Ky is a positive diagonal constant matrix, makes 

the origin (q = 0, ġ = 0) asymptotically stable. Under what additional 
conditions will it be globally asyinptotically stable? 


6.11 ([151]) Euler equations for a rotating rigid spacecraft are given by 


Ji = (Jo— Jg)waws + i 
Jas = (J3 — Ji )wgwi + u2 
Jwz = (A — Ja)u1uw2 T us 


where w to w3 are the components of the angular velocity vector along the principal 
axes, u; to us are the torque inputs applied about the principal axes, and J; to J3 
are the principal moments of inertia. 
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(a) Show that the map from u = [ui, uz, us]" to w = [o1 w2, wa] is lossless. 


(b) Let u = -Kw +v, where K is a positive definite symmetric matrix. Show that 
the map from v to w is finite-gain £2 stable. 


(c) Show that, when v = 0, the origin w = 0 is globally asymptotically stable. 


ips Consider the feedback system of Figure 6.11 where H, and H» have the state 
models 


ii = fz)-cTG(z)e, ys = hili) + Ji(zi}ei 


for i= 1,2. Show that the feedback system has a well-defined state model if the 
matrix J + J2(z2)J1(z1) is nonsingular for all x; and z3. 


6.13 Consider equations (6.26)-(6.27) and (6.30)-(6.31), and suppose hy =h, (21), 
Per E of ey. Show, in each case, that the equations have a unique solution 
€1, €2). 


6.14 Consider the feedback connection of Figure 6.11 with 


À dj = 2 ; 
Hi H fg = -21— hi(z2) +e, and Hà: { 73 = —%3+e2 
y = 22 y) = ha(zs) 


where hy and hz are locally Lipschitz functions, which satisfy hı € (0, 00], ^. 
eof, ha € 
(0, co], and |ha(z){ > |z|/(1 + z?) for all z. px UN 


(a) Show that the feedback connection is passive. 
(b) Show that the origin of the unforced system is globally asymptotically stable. 


6.15 Repeat the previous exercise for 


ii = -2%1+22 . 
Hi:4 a = -r3 -T+ 6 and H3: { T3 E eo te 
yl = 2 d M oce 


6.16 ({78]) Consider the feedback system of Figure 6.11, where H, and Ho are 
passive dynamical systems of the form (6.21)-(6.22). Suppose the feedback connec- 
tion has a well-defined state model and the series connection H 1(—- H3), with input 
ez and output y), is zero-state observable. Show that the origin is asymptotically 


Stable if H3 is input strictly passive or H; is output strictly passive. 


6.17 ([78]) Consider the feedback system of Figure 6.11, where H, and H3 are 
passive dynamical systems of the form (6.21)-(6.22). Suppose the feedback con- 
nection has a well-defined state model and the series connection HH, with input 
€; and output yo, is zero-state observable. Show that the origin is asymptotically 
stable if Hj is input strictly passive or H is output strictly passive. 
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6.18 ([78]) As a generalization of the concept of passivity, a dynainical system of 
the form (6.6)-(6.7) is said to be dissipative with respect to a supply rate w(u, y) 
if there is a positive definite storage function V(x) such that V < w. Consider the 
feedback system of Figure 6.11 where H; and H3 are zero-state observable, dvnaini- 
cal systems of the form (6.21)-(6.22). Suppose each of H, and H3 is dissipative with 
storage function V;(r;) and supply rate w;(ui, yi) = y! Qiyi + 2yZ Siu; + uT Riu; 
where Q; and R; are real symmetric matrices and S; is a real matrix. Show that 
the origin is stable (respectively, asymptotically stable) if the matrix 


o-| Qitak, ~-S,+ast 
—SP+aS, Ry +aQe 


is negative semidefinite (respectively, negative definite) for some a > 0. 


6.19 Consider the feedback connection of two time-invariant dynamical systeins 
of the form (6.21)-(6.22). Suppose both feedback components are zero-state ob- 
servable and there exist positive definite storage functions which satisfy 


ely > Vitel pile) - y pi(y:), fori - 1,2 


ints a the origin of the closed-loop system (6.24) when u = 0 is asymptotically 
stable i 


vT [pi(v) + va(v)] > 0 and vT[os(v) -v1(7v) >0, Vv 40 


Under what additional conditions will the origin be globally asymptotically stable? 


Chapter 7 


Frequency Domain Analysis of 
Feedback Systems 


Many nonlinear physical systems can be represented as a feedback connection of a 
linear dynamical system and a nonlinear element, as shown in Figure 7.1. The pro- 
cess of representing a system in this form depends on the particular system involved. 
For instance, in the casé in which a control system's only nonlinearity is in the form 
of a relay or actuator/sensor nonlinearity, there is no difficulty in representing the 
system in the feedback form of Figure 7.1. In other cases, the representation may 
be Jess obvious. We assume that the external input r = 0 and study the behavior of 
the unforced system. What is unique about this chapter is the use of the frequency 
response of the linear system, which builds on classical control tools like the Nyquist 
plot and the Nyquist criterion. In Section 7.1, we study absolute stability. The sys- 
tem is said to absolutely stable if it has a globally uniformly asymptotically stable 
equilibrium point at the origin for all nonlinearities in a given sector. The circle and 
Popov criteria give frequency-domain sufficient conditions for absolute stability in 


Figure 7.1: Feedback connection. 
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the form of strict positive realness of certain transfer functions. In the single-input- 
single-output case, both criteria can be applied graphically. In Section 7.2, we use 
the describing function method to study the existence of periodic solutions for a 
single-input-single-output system. We derive frequency-domain conditions, which 
can be applied graphically, to predict the existence or absence of oscillations and 
estimate the frequency and amplitude of oscillation when there is one. 


7.1 Absolute Stability 


Consider the feedback connection of Figure 7.1. We assume that the external input 
r — 0 and study the behavior of tlie unforced system, represented by 


t = Az Bu (7.1) 
y = CzcDu (7.2) 
u = (ty) (7.3) 


where x € R”, u,y € RP, (A, B) is controllable, (A,C) is observable, and v : 
[0, 00) x RP — RP is a memoryless, possibly time-varying, nonlinearity, which is 
piecewise continuous in £ and locally Lipschitz in y. We assume that the feedback 
connection has a well-defined state model, which is the case when i 


u = —y(t, Cz + Du) (7.4) 


has a unique solution u for every (t, z) in the domain of interest. THis is always tho 
case when D = 0. The transfer function matrix of the linear system 


G(s) 2 C(sI - A! B« D (7.5) 


is square and proper. The controllability and observability assumptions ensure 
that (A, B, C, D) is a minimal realization of G(s). From linear system theory, we 
know that for any rational proper G(s), a minimal realization always exists. The 
nonlinearity x) is required to satisfy a sector condition per Definition 6.2. The sector 
condition may be satisfied globally, that is, for all y € R”, or satisfied only for y € Y, 
a subset of RP, whose interior is connected and contains the origin. 

For all nonlinearities satisfying the sector condition, the origin z = 0 is an 
equilibrium point of the system (7.1)-(7.3). The problem of interest here is to 
study the stability of the origin, not for a given nonlinearity, but rather for a class 
of nonlinearities that satisfy a given sector condition. If we succeed in showing that 
the origin is uniformly asymptotically stable for all nonlinearities in the sector, the 
system is said to be absolutely stable. The problem was originally formulated by 
Lure and is sometimes called Lure's-problem. Traditionally, absolute stability has 
been defined for the case when the origin is globally uniformly asymptotically stable. 
To keep up this tradition, we will use the phrase “absolute stability" when the sector 
condition is satisfied globally and the origin is globally uniformly asymptotically 
stable. Otherwise, we will use the phrase "absolute stability with a finite domain." 


t^ 


7.1. ABSOLUTE STABILITY 


Definition 7.1 Consider the system (7.1)-(7.3), where s) satisfies a sector con- 
dition per Definition 6.2. The system is absolutely stable if the origin is globally 
uniformly asymptotically stable for any nonlinearity in the given sector. It is abso- 
lutely stable with a finite domain if the origin is uniformly asymptotically stable. 


We will investigate asymptotic stability of the origin by using Lyapunov analysis. 
A Lyapunov function candidate can be chosen by using the passivity tools of the: 
previous chapter. In particular, if the closed-loop system can be represented as 
a feedback connection of two passive systems, then the sum of the two storage 
functions can be used as a Lyapunov function candidate for the closed-loop system. 
The use of loop transformations allows us to cover various sectors and Lyapunov 
function candidates, leading to the circle and Popov criteria. 


7T.1.1 Circle Criterion 
Theorem 7.1 The system (7.1)-(7.3) is absolutely stable if 
* Y € [K1, 00] and G(s)[I + KiG(s)]-} is strictly positive real, or 


. y € (Ki, Ke], with K = Ka — Ki = KT > 0, and U+ K3G(s)]I + KiG(s)]"! 
ts strictly positive real. 


If the sector condition is satisfied only on a set Y C. RP, then the foregoing conditions 
ensure that the system is absolutely stable with a finite domain. o 


We refer to this theorem as the multivariable circle criterion, although the reason 
for using this name will not be clear until we specialize it to the scalar case. A nec- 
essary condition for equation (7.4) to have a unique solution u for every j € [K1, oo] 
or y € [K, Ka] is the nonsingularity of the matrix (I+ KD). This can be eson by 
taking  — Kıy in (7.4). Therefore, the transfer function [I+ K1G(s)]7! is proper. 


Proof of Theorem 7.1: We prove the theorem first for the sector [0,00] and re- 
cover the other cases by loop transformations. H% € [0, co] and G(s) is strictly pos- 
itive real, we have a feedback connection of two passive systems. From Lemma 6.4 
we know that the storage function for the linear dynamical system is V(z) = 
(1/2)x7 Px, where P = PT > 0 satisfies the Kalman-Yakubovich-Popov equations 


PA- ATP = -LT™L—eP (7.6) 
PB = CT- LITW (7.7) 
WTW = D«p* (7.8) 


and € > 0. Using V(z) as a Lyapunov function candidate, we obtain 


V = ja" Pà + 427 Pz = $27 (PA ATP) +27 PBu 
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Figure 7.2: V € [K1, oo] is transformed to V € [0, co] via a loop transformation. 


Using (7.6) and (7.7) yields 
ý 


= lgTLTL.- sex’ Pz aT (CT — LTW)u 


~ ja LT La ~ dex? Prt (Cr+ Du) 'u—u'Du-aTL'Wu 


Using (7.8) and the fact that u” Du = łu” (D + DT )u, we obtain 


V=- jer Pz- ds Ways + Wu) - yot v) 


Since y7 (t, y) > 0, we have 
V <- lexT Px 


which shows that the origin is globally cxponentially stable. If Y satisfies the sector 
condition only for y € Y, the foregoing analysis will be valid in some neighborhood 
of the origin, showing that the origin is exponentially stable. The case y € [K1, 00] 
can be transformed to a case where the nonlinearity belongs to [0, oo] via the loop 
transformation of Figure 7.2. Hence, the systein is absolutely stable if G(s) + 
Ki1G(s)]"! is strictly positive real. The case y € [Ki K2] can be transformed 
to a case where the nonlinearity belongs to [0,oo] via the loop transformation of 
Figure 7.3. Hence, the system is absolutely stable if 


I+ KG(s)[I + K1G(s)]"! = [I + KG(s)]I + K1G(s)]"! 


is strictly positive real. g 


Example 7.1 Consider the system (7.1)-(7.3) and suppose G(s) is Hurwitz and 
strictly proper. Let : 


^n = Sup Omax[G(jw)] = sup ||G(jw)|l2 
weR weR 
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Figure 7.3:  € [Ki, K2] is transformed to v € [0, oo] via a loop transformation. 


where max|'] denotes the maximum singular value of a complex matrix. The con- 
stant y; is finite, since G(s) is Hurwitz. Suppose v satisfies the inequality 


P(t, y)ll2 S *llvlle: Vt 2 0, V y€ RP (7.9) 


then it belongs to the sector [/£1, K2] with Kı = —72/ and K2 = «2I. To apply 
Theorem 7.1, we need to show that 


Z(s) = [I + 72G(s)][J - 2G(5)]* 


is strictly positive real. We note that det[Z(s) + ZT (—5)] is not. identically Zero 
because Z(oo) = I. We apply Leuuna 6.1. Since G(s) is Hurwitz, Z(s) will be 
Hurwitz if (/ — 32G(s)]"! is Hurwitz. Noting that! 


Omin{l — 72G(jw)| 2 1-172 


we see that if 4142 < 1, the plot of det [I —72G(jw)] will not go through nor encircle 
the origin. Hence, by the multivariable Nyquist criterion,? [J—72G(s)|~! is Hurwitz; 
consequently, Z(s) is Hurwitz. Next. we show that 


Z(jw) + Z7(-jw) »0, Vu € R 


'The following properties of singular values of a complex matrix are used: 
det G #0 © emin[G] > 0 


Cmax|G  !] = l/€min|G], if @min[G] 20 
Cmin|I + G] > 1— omax[G] 
Zmax[C162] < Omax[G1]omax[G2] 


?See (33, pp. 160-161] for a statement of the multivariable Nyquist criterion. 
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The left-hand side of this inequality is given by 

U +G — 2G lw) 

+ [I - GT (jo)! U + 2267 (-Jw)] 

[I - xG? (—ju)|"? [ar - iG" Cw) Gu)] 
x [I - mGGw)|7*. 


Z(ju) + Z7 (-jw) 


Hence, Z(jw) + ZT (—jw) is positive definite for all w if and only if 
amin |! — AGT (-ju)G(jw)] > 0, Ve € R 
Now, for 5*2 < 1, we have 


Omin[I — 5267 (—jw)G(jw)] 1 — Va max[G" (—jw)]Fmax|G Go] 


2 
> 1- > 0 


iti f Lemma 6.1 are satisfied 
inally, Z(oo) + ZT (oo) = 2I. Thus, all the conditions o i 
ides EUM that Z(s) is strictly positive real and the system is absolutely stable 


if 4149 < 1. This is a robustness result, which shows that closing the loop around . 


a Hurwitz transfer function with a nonlinearity satisfying (7.9), with a cae 
small y2, does not destroy the stability of the system. 


:onditi 1 can be verified graphically 
In the scalar case p = 1, the conditions of Theorem 7. grap À 
by exainining the Nyquist plot of G(jw). For w € [a, B], with -> a, the system is 
absolutely stable if the scalar transfer function 
_ 1+8G(s) 


Zi) = Ty aGls) 


is strictly positive real. To verify that Z(s) is strictly positive real, we = use 
Lemma 6.1 which states that Z(s) is strictly positive real if it is Hurwitz an 


E - (70) 
Re Eod 20, Vu€ [ oo, oo] 


To relate condition (7.10) to the Nyquist plot of G(jw), we have to distinguish 
between three different cases, depending on the sign of a. : Consider first the case 
when f > a> 0. In this case, condition (7.10) can be rewritten as 

s +G(jw) 
2+ G(jw) 


| >0, Vw E |-o, 00] (7.11) 


For a point q on the Nyquist. plot of G(ju), the two complex numbers (1/ B) GGw) 
and (1/a) +G(jw) can be represented by the lines connecting g to —(1/8) + j0 and 


“The inequality 772 < 1 can be derived also [rom the small-gain theorem. (See Example 5.13.) 


Figure 7.4: Graphical representation of the circle criterion. 


—(1/o) 4- j0, respectively, as shown in Figure 7.4. The real part of the ratio of two 
complex numbers is positive when the angle difference between the two numbers 
is less than 7/2; thet is, the angle (01 — 62) in Figure 7.4 is less than 71/2. If we 
define D(o, 8) to be the closed disk in the complex plane whose diameter is the 
line segment*connecting the points —(1/a) + j0 and —(1/8) + j0, then it is simple 
to see that the angle (01 — 02) is less than 7/2 when q is outside the disk D(a, 8). 
Since (7.11) is required to hold for all w, all points on the Nyquist plot of G(jw) 
must be strictly outside the disk D(a, 8). On the other hand, Z(s) is Hurwitz if 
G(s)/[1 + oG(s)] is Hurwitz. The Nyquist criterion states that G(s)/[1 + aG(s)] 
is Hurwitz if and only if the Nyquist plot of G(jw) does not intersect the point 
—(1/a)+J0 and encircles it exactly m times in the counterclockwise direction, where 
m is the number of poles of G(s) in the open right-half complex plane.* Therefore, 
the conditions of Theorem 7.1 are satisfied if the Nyquist plot of G(jw) does not 

enter the disk D(a, 8) and encircles it m times in the counterclockwise direction. 

Consider, next, the case when 8 > 0 and a = 0. For this case, Theorem 7.1 requires 

1+ BG(s) to be strictly positive real. This is the case if G(s) is Hurwitz and 


Re[1 + BG(jw)] » 0, Vw € [-00, oo] 
The latter condition can be rewritten as 


Re[G(ju)] > - EN V w € [-00, o9] 


which is equivalent to the graphical condition that the Nyquist plot of G(jw) lies 
to the right of the vertical line defined by Re[s] = —1/8. Finally, consider the case 


ee ÓÁ— RENS . 
4When G(s) has poles on the imaginary axis, the Nyquist path is indented in the right-half 


plane, as usual. 
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when a < 0 < f. In this case, condition (7.10) is equivalent to 


e 3 FO) «0, V 
IYGQo) ; Vw € [700,6] (7.12) 
where the inequality sign is reversed because, as we go from (7.10) to (7.12), we 
par by a/@, which is now negative. Repeating previous arguments, it can be 
a ding that for (7.12) to hold, the Nyquist plot of G(jw) must lie inside the 
lis (a, 8). Consequently, the Nyquist plot cannot encircle the point —(1/a) + 
j0. Therefore, from the Nyquist criterion, we see that G(s) must be Hurwitz for 
G(s) /[i aG(s)] to be so. The stability criteria for the three cases are summarized 
in the following theorem, which is known as the circle criterion. 


Theorem 7.2 Consider a scalar system of the form (7.1)-(7.3), where (A, B,C, D) 
isa minimal realization of G(s) and v € |æ, 8]. Then, the system is absolutely stable 
if one of the following conditions is satisfied, as appropriate: 


1. If 0< a < B, the Nyquist plot of G(jw) does not enter the disk D(a, 8) and 
encircles it m times in the counterclockwise direction, where m is the number 
of poles of G(s) with positive real parts. 


2. If0 =a < B, G(s) is Hurwitz and the Nyquist (jw) li 
; yquist plot of G lies t 
of the vertical line defined by Re[s] = -i/á. rud D 


3. Ifa « 0 < B, G(s) is Hurwitz and the Nyquist plot of G(jw) lies i 
interior of the disk D(a, B). ud i ae 


if the sector condition is satisfied only on an interval [a,b], then the foregoing con- 
ditions ensure that the system is absolutely stable with a finite domain. o 


The círcle criterion allows us to investigate absolute stability by usi 
the Nyquist plot of G(jw). This is important because the rub eng ipd 
determined directly from experimental data. Given the Nyquist plot of G(jw), we 
can determine permissible sectors for which the system is absolutely stable. The 
next two exainples illustrate the use of the circle criterion. i 


Example 7.2 Let 
4 


(s+ 1)($5+ 1) (35 +1) 


The Nyquist plot of G(jw) is shown in Figure 7.5. Since G(s) is Hurwitz. we can 
allow a to be negative and apply the third case of the circle criterion. So, we need 
to determine a disk D(a, 8) that encloses the Nyquist plot. Clearly, the choice of 
the disk is not unique. Suppose we decide to locate the center of the disk at tlic 
origin of the complex plane. This means that we will work with a disk D(—42,32), 
whore the radius (1/42) > 0 is to be chosen. The Nyquist plot will be inside. this 


G(s) = 
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Figure 7.5: Nyquist plot for Example 7.2. 


disk if |G(jw)| < 1/72. In particular, if we set 71 = sup er |G(jw)|, then y2 must 
be chosen to satisfy 4142 < 1. This is the same condition we found in Example 7.1. 
It is not hard to see that {G(jw)| is maximum at w = 0 and y; = 4. Thus, y2 must 
be less than 0.25. Hence, we can conclude that the system is absolutely stable for all 
nonlinearities in the sector [-0.25-+¢, 0.25 — e], where € > 0 can be arbitrarily small. 
Inspection of the Nyquist plot and the disk D(—0.25,0.25) in Figure 7.5 suggests 
that the choice to locate the center at the origin may not be the best one. By locating 
the center at another point, we might be able to obtain a disk that encloses the 
Nyquist plot more tightly. For example, let us locate the center at the point 1.5 + 70. 
The maximum distance from this point to the Nyquist plot is 2.834. Hence, choosing 
the radius of the disk to be 2.9 ensures that the Nyquist plot is inside the disk 
D(-1/4.4,1/1.4), and we can conclude that the system is absolutely stable for all 
nonlinearities in the sector [-0.227, 0.714]. Comparing this sector with the previous 
one (see Figure 7.6) shows that by giving in a little bit on the lower bound of the 
sector, we achieve a significant improvement in the upper bound. Clearly, there is 
still room for optimizing the choice of the center of the disk, but we will not pursue 
it. The point we wanted to show is that the graphical representation used in the 
circle criterion gives us a closer look at the problem, compared with the use of norm 
inequalities as in Example 7.1, which allows us to obtain less conservative estimates 
of the sector. Another direction we can pursue in applying the circle criterion is to 
restrict a to zero and apply the second case of the circle criterion. The Nyquist plot 
lies to the right of the vertical line Re[s] = —0.857. Hence, we can conclude that 
the system is absolutely stable for all nonlinearities in the sector (0, 1.166]. This 
sector is sketched in Figure 7,6, together with the previous two sectors. It gives the 
best estimate of f, which is achieved at the expense of limiting the nonlinearity to 
be a first-quadrant-third-quadrant nonlinearity. To appreciate how this flexibility 
in using the circle criterion could be useful in applications, let us suppose that we 
are interested in studying the stability of the system of Figure 7 .7, which includes a 
limiter or saturation nonlinearity (a typical nonlinearity in feedback control systems 
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l a (-0.25,0.25) 


si ~~. [0.1.166] 
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Figure 7.6: Sectors for Example 7.2. 


due to constraints on physical variables). The ae ME id regen 
it is i i 11 ut not in 
0, 1]. Therefore, it is included in the sector 0, 66], 
en p or [—0.227,0.714]. Thus, based on the application of the sapi cue 
of the circle criterion, we can conclude that the feedback system of Figure 7. x 
a globally asymptotically stable equilibrium point at the origin. 


4 
G(s) = GFl)(s/2+1)(878+1) 


Figure 7.7: Feedback connection with saturation nonlinearity. 


\ 


\ 


Example 7.3 Let 4 


~ (sS 1) 1o o 1) (3s +1) 

i r function is not Hurwitz, since it has a pole in the open right-half plane. 
S restrict a to be positive and apply the first case of the circle vee 
The Nyquist plot of G(jw) is shown in Figure 7.8. From the circle criterion, Wa = 
that the Nyquist plot must encircle the disk D(a, B) once in the pasan = se 
direction. Inspection of the Nyquist plot shows that a disk can be nah : y tl j 
Nyquist plot only if it is totally inside one of the two lobes formed by the dos 
plot in the left-half plane. A disk inside the right lobe is encircled yet n : 
clockwise direction, Hence, it does not satisfy the circle criterion. A dis 
the left lobe is encircled once in the counterclockwise direction. Thus, we nee 


G(s) 


Figure 7.8: Nyquist plot for Example 7.3. 


choose a and £ to locate the disk D(a, £) inside the left lobe. Let us locate the 
center of the disk at the point —3.2 + j0, about halfway between the two ends of 
the lobe on the real axis. The minimum distance from this center to the Nyquist 
plot is 0.1688. Hence, choosing the radius to be 0.168, we conclude that the system 
is absolutely stable for all nonlinearíties in the sector [0.2969, 0.3298]. A 


In Examples 7.1 through 7.3, we have considered cases where the sector condition 


is satisfied globally. In the next example, the sector condition is satisfied only on a 
finite interval. 


Example 7.4 Consider the feedback connection of Figure 7.1, where the linear 
system is represented by the transfer function 


s+2 
= Gr - 

and the nonlinear element is (y) = sat(y). The nonlinearity belongs globally to 
the sector [0,1]. However, since G(s) is not Hurwitz, we must apply the first case 
of the circle criterion, which requires the sector condition to hold with a positive 
a. Thus, we cannot conclude absolute stability by using the circle criterion. The 
best we can hope for is to show absolute stebility with a finite domain. Figure 7.9 
shows that on the interval [-a, a], the nonlinearity 1 belongs to the sector lo, 6] 
with a = 1/a and f = 1. Since G(s) has a pole with positive real part, the Nyquist 
plot of G(jw), shown in Figure 7.10, must encircle the disk D(a, 1) once in the 
counterclockwise direction. It can be verified, analytically, that condition (7.10) is 
satisfied for a > 0.5359. Thus, choosing a = 0.55, the sector condition is satisfied on 
the interval [~1.818, 1.818] and the disk D(0.55, 1) is encircled once by the ‘Nyquist 
plot in the counterclockwise direction. From the first case of the circle criterion, we 


5In fact, the origin is not globally asymptotically stable because the system has three equilib- 
rium points. 
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Figure 7.9: Sector for Example 7.4. 
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| TN 
-05 Sad 
-2 -1.5 -1 -0.5 0 
Figure 7.10: Nyquist plot for Example 7.4. 
conclude that the system is absolutely stable with a finite domain. We can also use 


a quadratic Lyapunov function V(z) = 27 Pz to estimate the region of attraction. 
Consider the state model 


i = c 

t2 = zu 
y = 2xi-ctz2 
u = -V(y) 


‘The loop transformation of Figure 7.3 is given by 


u 
y 


-ay-cü = -0.55y +ù 
(8—o)-ü = 0.45y +ã 


Thus, the transformed linear system is given by 


t= Ar+ Bù, ğ=Cxr+Dù 
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zd 5 -1 -0.5 0 0.5 1 1.5 


Figure 7.11: Region of attraction for Example 7.4. 


where 


0 1 0 
^ [s aig) on [t] 2008 noe 


The matrix P is the solution of equations (7.6) through (7.8). It can be verified 
that® 


0.4946 0.4834 


e =0.02,. P = | 0.4834 1.0774 


| , L=[ 0.2946 —0.4436 ], and W = v2 
satisfy (7.6) through (7.8). Thus, V (z) = x? Pz is a Lyapunov function for the 
system. We estimate the region of attraction by 

|f -(zeR'|V(z)&e) 


where c € minyjyj=1.818} V (z) = 0.3445 to ensure that f), is contained in the set 
{ly] € 1.818}. Taking c = 0.34 gives the estimate shown in Figure 7.11. A 


7.1.2 Popov Criterion 
Consider a special case of the system (7.1)-(7.3), given by 


= Ar+Bu i (7.13) 
u = -W(w) 1<i<p (7.15) 


where z € R”, u, y € RP, (A, B) is controllable, (A, C) is observable, and y; : R —^ R 
is a locally Lipschitz memoryless nonlinearity that belongs to the sector [0, k;]. In 
this special case, the transfer function G(s) = C(sI — A)^!B is strictly proper 


SThe value of € is chosen such that G(s—«/2) is positive real and [(/2)1 + A] is Hurwitz, where 
G(s) = C(sI — A)71B + D. Then, P is calculated by solving a Riccati equation, as described in 
Exercise 6.8. 
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Figure 7.12: Loop transformation. 


; that is, (y) = ¥i(ys). Since D = 0, the 
is time invariant and decoupled; that is, sj;(y) viui). 
nete ronan has a well-defined state model. The aa Eden d 
ivari iteri i d.by using a (Lure-type ap 
as the multivariable Popov criterion, is prove re-t i i 
function of the form V = (1/2)27 Px + E y: fy. vilo) de, which is je ne 
the application of a loop transformation that transforms the system (T. ] 
into the feedback connection of two passive dynamical systems. 


Theorem 7.3 The system (7.13)-(7.15) is absolutely stable if, frisis r 
v; € [0,k:], 0 < ky < 00, and there exists a constant ^; > 0, with (1+ jw) ih 
for ery eigenvalue àk of A, such that M+ (I+ E pod npa in 
i { = di kue’ l i e sector 
here T = diag(71,***, p) and M = diag(1/ nins Ik). Hf ton 
" : (0, ky] is ee only on a set Y C RP, then the foregoing conditions Tum 
1 H H H 
that the system is absolutely stable with a finite domain. 


Proof: The loop transformation of Figure 7.12 results in a feedback connection of 
A, and Hz, where Hi, is a linear system whose transfer function is 


M+([+s)G(s) = M+(I+sT)C(sI - A) B l 
= M4+C(sI- AyY!B-«TCs(sI - A) B 2 
= M-C(sl- AJ! B«TC(sI - A+ A)(sI- A) B 
= M+(C+ICA)(sf - A?! B--TCB 


reali del {A, B,C, D), where 
I + sf)G(s):can be realized by the state mo ,B, 
e c Dou CA, and D = M +TCB. Let A; be an eigenvalue of A 
and v, be the associated eigenvector. Then 


(C -TCA)v, = (C +C ywr = (1 + aT) Coe 


` a ow 
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The condition (1--A*;) # 0 implies that (4, C) is observable; hence, the realization 
(A, B, C, D) is minimal. If M + (I + sD)G(s) is strictly positive real, we can apply 
the Kalman-Yakubovich-Popov lemma to conclude that there are matrices P = 
PT > 0, L, and W, and a positive constant € that satisfy 


PA+ATP = ~LTL~ep (7.16) 
PB = (C4rCAYy —LTW (7.17) 
WTW = 2M +TCB+BTOTT (7.18) 


and V = (1/2)z7 Pz is a storage function for Ef, One the other hand, it can be veri- 
fied (Exercise 6.2) that H is passive with the storage function 577... i f" vila) do. 


Thus, the storage function for the transformed feedback connection of Figure 7.12 
is 


P v 
V= da” Pr + Sa f Vi(c) do 
i=l 9 

We use V as a Lyapunov function candidate for the original feedback connection 
(7.13)-(7.15). The derivative V is given by 

Vi = daTPi.diTPzay(yj 
= daT(PA. ATP) E aT PBu 4- VT (y).FC(Az + Bu) 
Using (7.16) and (7.17) yields | 


V = -daTLTLIz— Lea™Pe +27 (CP + ATCTD - LTW)u 
t VT (y)PCAx + YT (yTC Bu 


Substituting u = —v(y) and using (7.18), we obtain 
V=- iexTPz- l(Lz--Wu)T(Lz + Wu) - ply) ly — My(y)| x — Zea? Pr 


which shows that the origin is globally asymptotically stable. If v satisfies the sector 
condition only for y € Y, the foregoing analysis will be valid in some neighborhood 


of the origin, showing that the origin is asymptotically stable.  . o 


For M + (I + sT)G(8) to be strictly positive real, G(s) must be Hurwitz. As 
we have done in the circle criterion, this restriction on G(s) may be removed by 
performing a loop transformation that replaces G(s) by G(s)[I + K1G(s)]-1. We 
will not repeat this idea in general, but will illustrate it by an example. In the scalar 
case p = 1, we can test the strict positive realness of Z (8) = (1/k) + (1 + ey)G(s) 
graphically. By Lemma 6.1, Z (8) is strictly positive real if G(s) is Hurwitz and 


i + Re[G(ju}] ~ wlm{G(ju)] » 0, Yw € [-00, oc] (7.19) 


latin Smee ysedinmeey e aei i ak d e 
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slope = 1/y elm[G(j«)] 


Re[G(kx] 


Figure 7.13: Popov plot. 


where G(jw) = Re[G(jw)] + JIm[G(jw)]. If we plot Re[G(jw)] versus wim(G(jw)] 

with w as à parameter, then condition (7.19) is satisfied if the plot lies to the 

right of the line that intercepts the point -(1/k) + j0 with a slope 1/7. (See 

Figure 7.13.) Such a plot is known as a Popov plot, in contrast to a Nyquist plot 

Misi zc pid Baus a nel If condition (7.19) is satisfied only 
100), -hand si 

wb t e approaches zero as w tends to oo, then 


" l 
m w’ f + Re[G(jw)] - véln[GGu)]) 20 


This case arises when k = co and G(s) has relative degree two. 

‘With y= 0, condition (7.19) reduces to the circle criterion condition Re(G(jw)| > 
-Vk, which shows that, for the system (7.13)-(7.15), the conditions of the Popov 
criterion are weaker than those of the circle criterion. In other words, with y > 0 
absolute stability cen be established under less stringent conditions. 


Example 7.5 Consider the second-order system 


ij = r$ 
$3 = -z$-—h(y) 
y= n 


This system would fit the form (7.13)-(7.15) if we took 4 = h, but the matrix A 
would not be Hurwitz. Adding and subtracting the term ay to the right-hand side 
of the second state equation, where a > 0, and defining ¥(y) = h(y) — ay, the 
system takes the form (7.13)~(7.15), with 


IM EJ. 2-|1]. and C- [1 0] 
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-0.5 0. 0.5 1 


Figure 7.14: Popov plot for Example 7.5. 


Assume that h belongs to a sector [o, 2], where 8 > o. Then, v belongs to the 
sector [0, k], where k = 8 — o. Condition (7.19) takes the form 
1. a-w? +y? 


+ 


For all finite positive values of o: and k, this inequality is satisfied by choosing y > 1. 
Even at k = 00, the foregoing inequality is satisfied for all w € (—00, œ0).and 


2 2 2 

, w(a-w TE e cdd 
wc (aw?) +w? 
Hence, the system is absolutely stable for all nonlinearities h in the sector [a, oo], 
where a can be arbitrarily small. Figure 7.14 shows the Popov plot of G(jw) for 
a = 1. The plot is drawn only for w > 0, since Re[G(jw)] and wIm[G(3w)] are 
even functions of w. The Popov plot asymptotically approaches the line through 
the origin of unity slope from the right side. Therefore, it lies to the right of any 
line of slope less than one that intersects the real axis at the origin and approaches 
it asymptotically as w tends to oo. To see the advantage of having y > 0, let us 
take 4 = 0 and apply the circle criterion. From the second case of Theorem 7.2, 
the system is absolutely stable if the Nyquist plot of G(jw) lies to the right of the 
vertical line defined by Re[s] = —1/k. Since a portion of the Nyquist plot lies in 
the left-half plane, k cannot be arbitrarily large. The maximum permissible value 
of k can be determined analytically from the condition 


which yields k < 1+2/a. Thus, using the circle criterion, we can only conclude that 
the system is absolutely stable for all nonlinearities h in the sector (a, 1+a+2/a-€], 
where a > 0 and € > 0 can be arbitrarily small. A 
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7.2 The Describing Function Method 


Consider a single-input-single-output nonlinear system represented by the feedback 
connection of Figure 7.1, where G(s) is a strictly proper, rational transfer function 
and v is a time-invariant, memoryless nonlinearity. We assume that the external 
= 0 and study the existence of periodic solutions. A periodic solution 
satisfies y(t + 2/w) = y(t) for all t, where u is the frequency of oscillation. We 
will use a general method for finding periodic solutions, known as the method of 
harmonic balance. 'The idea of the method is to represent a periodic solution by & 
Fourier series and seek a frequency w and a set of Fourier coefficients that satisfy 


the system’s equation. Suppose y(t) is periodic and let « 


input r 


y(t)= V ax exp(jkwt) 


k=—0o 


be its Fourier series, where a are complex coefficients,” a, = ā-k and j = y~. 
Since V(-) is a time-invariant nonlinearity, (y(t) is periodic with the same fre- 
quency w and can be written as d 


v(yt)) = D> cxexp(jkut) 
k=—00 


where each complex coefficient cj is a function of all a;'s. For y(t) to be a solution 
of the feedback system, it must satisfy the differential equation 


d(p)y(t) + n(p)b(y(t)) = 0 


where p is the differential operator p(-) = d(-)/dt and n(s) and d(s) are the numer- 
ator and denominator polynomials of G(s). Because 


pexp(jkwt) = E exp( jk) = jkwexp(jkwt) 


we have woh a 
d(p Y ax exp(jkwt) = 33 d(jkw)ai exp(jkwt) 
and " is 
n(p) D cx expl jkwt) = DD n(jkw)ey exp(jkwt) 
=~00 k=~00 


Substituting these expressions back into the differential equation yields 


D [d(jkw)a, + nGkw)ex] exp(jkwt) = 0 


z—00 


MEILEN es y 
7A bar over a complex variable denotes its complex conjugate. 
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Using the orthogonalit i ] 
y of the functions exp(jkwt) for di S 
that the Fourier coefficients must satisfy Ere Neqoe opened 


for all integers k. Because G(j Y-i 
: jkw) = G(-jku), ay = à.,, and cy = & 
fees F Blas e wide: (7.20) is an rude dida fran 
. We need to find a finite-dimensional imation of 
(7.20). Noting that the transfer functi i C 
r ction G(s) is strictly proper, that i j 
as w — oo, it is reasonable to assume that there i eeu Ue lees 
MERC OUR aac ere is an integer q > 0 such that for 
i | IGGko gh to replace G(jkw) (and conse 
his approximation reduces (7.20) to a inside, d iis 


G(jkw)é --àp 2 0, k=0,1,2,...,g (7.21) 


where the Fourier coefficients are written with a hat accent t 
7 * o i 
inane Nomis » d to the solution of epatis qim 
21). However, the complexity of i i 

asc for ia q, the finite-dimensional richie (31) ea ie ee 
dE ie nae problem results if we can choose q = 1. This, of ae 
Mur deus Hes er function G(s) to have sharp “low-pass filtering" characteristics 
ipee) oe GMBH) by 0 for all k > 1. Even though we know G(s) 
Hippie g | whether this is a good approximation, since we do not know the 

quency of oscillation w. Nevertheless, the classical describing function method 


pp 
makes this approximation and sets Qk = 0 for k > 1 to reduce the problem to one 


G(0)6o (ao, à1) Ttg = 0 (7 22) 
Gljw)ê (âo â) +4, = 0 (7.23) 


des m ee) and (7.23) define one real equation (7.22) and one complex equa 
Pu d A in two real unknowns, w and Go, and a complex unknown à Wh à 
: pus bre Serie they define three equations in four iaoa This 

1 ecause the time origin is arbitrary fi ; 
; i : rary for an autonomo i 
uv : ys ie equation, then (ĉo, à16/9) will give another ule i 
. e care of this nonuniqueness, we take the first harmonic of y(t) 


y WI z 
to be asinwt, w th a 0 that 18, we choose the time or ins ch t at t e h of 
) , 1g; n su h h P. ase 


A a 
asinwt = 7 [exp(jut) — exp(-jut)] = â = » 


we rewrite (7.22) and K .23) as 
2 H = ( /à ) 


GGoys (a =) oF 
Gu)à âo z; +3 = 0 (7.28) 


H E 
ierit 


* 
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Since (7.24) does not depend on w, it may be solved for Go as a function of a. Note 


that if (-) is an odd function, that is, 


V(-y) = -v(y) 


then ap = ĉ = 0 isa solution of (7.24) because 


21/w 
& = =| (Go + asinwt) dt 


For convenience, let us restrict our attenti i iti i 
1 e ion to nonlinearities with odd symmet; 
and take ĉo = ĉo = 0. Then, we can rewrite (7.25) as ý id 


ES a a 
G(jw)à (0, =) + 2j =0 (7.26) 


The coefficient é(0,a/2j) is the complex Fourier coefficient of the first harmonic at 


the oe of the nonlinearity when its input is the sinusoidal signal asinwt. It is 
given by 


w perl 


& (0, a/2j) 


on A V(a sinwt) exp(—jwt) dt 


w 2r/w 
m f [V(asinwt) cos vt — jV(a sinwt) sin wt] dt 


The first term under the integral sign is an odd function, while the second term 
is an even function. Therefore, the integration of the first term over one complete 
cycle is zero, and the integral simplifies to 


x ; w (The 
&(0,2/25) = E V (a sinwt) sin wt dt 
0 
Define a function V(a) by 


_ 61(0,0/2j) 2» pre , — , 
V(a) = "am = = V (asinwt) sinwt dt (7.27) 


so that (7.26) can be rewritten as 


Since we are not interested in a solution with a = 0, we can solve (7.28 
by finding all solutions of ' ve (7.28) completely 
G(jw)W(a) +1=0 (7.29) 


Equation (7.29) is known as the first-order harmonic balance equation, or simply 
the harmonic balance equation. The function (a) defined by (7.27) is called the 
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describing function of the nonlinearity y. It is obtained by applying a sinusoidal 
signal asinwt at the input of the nonlinearity and by calculating the ratio of the 
Fourier coefficient of the first harmonic at the output to a. It can be thought of as 
an “equivalent gain” of a linear time-invariant element whose response to asinwt is 
U(a)asinwt. This equivalent gain concept (sometimes called equivalent lineariza- 
tion) can be applied to more general time-varying nonlinearities or nonlinearities 
with memory, like hysteresis and backlash. In that general context, the describ- 
ing function might be complex and dependent on both a and w. We will only 
deal with describing functions of odd, time-invariant, memoryless nonlinearities for 
which &(a) is real, dependent only on a, and given by the expression 


(a) = E f " v(asin 8) sind d (7.30) 


which is obtained from (7.27) by changing the integration variable from t to 0 = wt. 

The describing function method states that if (7.29) has a solution (as, ws), then 
there is “probably” a periodic solution of the system with frequency and amplitude 
(at the input of the nonlinearity) close to ws and as. Conversely, if (7.29) has no 
solutions, then the system “probably” does not have a periodic solution. More 
analysis is needed to replace the word “probably” with “certainly” and to quantify 
the phrase "close to ws and a," when there is a periodic solution. We will postpone 
these investigations until a later point in the section. For now, we would like to 
look more closely at the calculation of the describing function and the question of 
solving the harmonic balance equation (7.29). The next three examples illustrate 
the calculation of the describing function for odd nonlinearities. 


Example 7.6 Consider the signum nonlinearity (y) = sgn(y). The describing 


function is given by 


D5 kee 25372 4 
wa) == [ w(asin6) sind do = = | sind dô = — 


nma 


A 


Example 7.7 Consider the piecewise-linear function of Figure 7.15. If a sinusoidal 
input to this nonlinearity has amplitude a < 6, the nonlinearity will act as a linear 
gain. The output will be a sinusoid with amplitude s;a. Hence, the describing 
function is V(a) = sı, independent of a. When a > 4, we divide the integral on 
the right-hand side of (7.30) into pieces, with each piece corresponding to a linear 
portion of #(-). Furthermore, using the odd symmetry of the output waveform, we 
simplify the integration to 


2 x 4 n/2 l 
Yla) = ZJ V(asin8)sin dd = F v(asin@)sin@ dé 
TG Jo Ta Jo 


8See [18] or [85]. 
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w(a sin) 


y 
0 


Figure 7.15: Piecewise-linear function. 


p 
Im as; sin? 6 dé 


Ta Jo 
4 P D 
+ ~ | [651 + s2(asin ð — 6)]sin@ dé, B= sin^! (5) 
Ta Jp a 


ES TN ) 4ô(sı — S2) PEA 
m (s zine Xie (cos 8 cos 5) 


\ 

2s9 [T l3 e. 

T (5 5 sint p+ gena) 
=e 6 4 

= Nei 1) (5 Eeo) m 


T 


vo = ea E G-E] s 


A sketch of the describing function is shown in Figure 7.16. By selecting specific 
values for ô and the slopes s; and sz, we can obtain the describing function of several 
common nonlinearities. For example, the saturation nonlinearity is a special case of 
the piecewise-linear function of Figure 7.15 with ô= 1, sı = 1, and s2 = 0. Hence, 


Thus, 


A QN ER A: 
A ME 
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Y (a) v' (a) 


a 


Figure 7.16: Describing function for the piecewise-linear function of Figure 7.15. 


its describing function is given by 


V(a) = 


if0<e<1 


2 [sin (2) +2 1- ( . fasi 


A 


Example 7.8 Consider an odd nonlinearity that satisfies the sector condition 


ay? € yd(y) < By? 


for all y € R. The describing function V(a) satisfies the lower bound 


Te eae te 2a [" 
ta) == : v(asiné) sind do > 72. f sin? @ dó =a 
0 


and the upper bound 


UE Su TR 28 f" 
V(a)- — | w(asin8)sinó dð € — | sin?@ d?=B 
TA Jo T Jo 


"Therefore, 
a< Va) <p, Va20 


Since the describing function V (a) is real, (7.29) can be rewritten as 


{Re[G(jw)] + jlm[G(jw)]} W(a) +1 — 0 


This equation is equivalent to the two real equations 


1+ V(o)Re[GGw)] = 
Im|G(ju) = 


0 
0 


(7.31) 
(7.32) 


—— Nes 
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Because (7.32) is independent of a, we can solve it first for w to determine the pos- 
sible frequencies of oscillation. For each solution w, we solve (7.31) for a. Note that 
the possible frequencies of oscillation are determined solely by the transfer function 
G(s); they are independent of the nonlinearity V(-). The nonlinearity determines 
the corresponding value of a, that is, the possible amplitude of oscillation. This pro- 


cedure can be carried out analytically for low-order transfer functions, as illustrated 
by the next examples. 


Example 7.9 Let 


1 
G(s) = —————— 
. (s) s(s + 1)(s +2) 
and consider two nonlinearities: the signum nonlinearity and the saturation nonlin- 
earity. By simple manipulation, we can write G(jw) as 


—3w ~ j (2- w?) 


G(jw —L C RARO e 
Ju) 9u3 + w (2 — w2)? 


Equation (7.32) takes the form 


(2-w?) 
DEFENCE s 
9u? + w (2 — w?) 


which has one positive root w = VŽ. Note that for each positive root of (7.32) 
there is a negative root of equal magnitude. We only consider the positive roots. 
Note also that a root at w = 0 would be of no interest because it would not give rise 
to a nontrivial periodic solution. Evaluating Re[G(jw)] at w = v2 and substituting 
it in (7.31), we obtain V(a) = 6. All this information has-been gathered without 
specifying the nonlinearity V(-). Consider now the signum nonlinearity. We found 
in Example 7.6 that &(a) =-4/ma. Therefore, U(a2) = 6 has a unique solution 
a = 2/3. Now we can say that the nonlinear system formed of G(s) and the signum 
nonlinearity will “probably” oscillate with frequency close to /2 and amplitude 
(at the input of the nonlinearity) close to 2/3. Consider next the saturation 
nonlinearity. We found in Example 7.7 that V(a) < 1 for all a. Therefore, W(a) = 6 
has no solutions. Therefore, we expect that the nonlinear system formed of G(s) 
and the saturation nonlinearity will not have a sustained oscillation. A 


Example 7.10 Let 
` =g 
s? +0.83 +8 
and consider two nonlinearities: the saturation nonlinearity and a dead-zone non- 


linearity that is a special case of the piecewise-linear function of Example 7.7 wit 
81 = 0, s2 = 0.5, and ô = 1. We can write G(jw) as : 


—0.8? — jw (8 — w2 
G(jw) = 0.8? — jw (8 w?) 


0.64w? + (8 — w?)? 


G(s) = 
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Equation (7.32) has a unique positive root w = 2/2. Evaluating Re[G(jw)] at 
w = 2/2 and substituting it in (7.31), we obtain V(a) = 0.8. For the saturation 
nonlinearity, the describing function is given in Example 7.7, and W(a) = 0.8 has 
the unique solution a = 1.455. Therefore, we expect that the nonlinear system 
formed of G(s) and the saturation nonlinearity will oscillate with frequency close 
to 2/2 and amplitude (at the input of the nonlinearity) close to 1.455. For the 
dead-zone nonlinearity, the describing function V(a) is less than 0.8 for all a. Thus, 
UW(a) = 0.8 has no solutions, and we expect that the nonlinear system formed of 
G(s) and the dead-zone nonlinearity will not have sustained oscillations. In this 
particular example, we can confirm the no oscillation conjecture by showing that 
the system is absolutely stable for a class of sector nonlinearities, which includes 
the given dead-zone nonlinearity. It can be easily checked that 


Re[G(jw)] > -1.25, V» € R 


Therefore, from the circle criterion (Theorem 7.2), we know that the system is 
absolutely stable for a sector [0,6] with 8 < 0.8. The given dead-zone nonlinear- 
ity belongs to this sector. Consequently, the origin of the state space is globally 
asymptotically stable and the systein cannot have a sustained oscillation. A 


Example 7.11 Consider Raleigh's equation 


g+z2=6(2- 12) 
where £ is a positive constant. To study existence of periodic solutions, we represent 
the equation in the feedback form of Figure 7.1. Let u = —23/3 and rewrite the 
system's equation as 


ž—eż+z = eu 
u = — 32 


The first equation defines a linear system. Taking y = ż to be its output, its transfer 


function is s 


s?~es+1 

The second equation defines a nonlinearity (y) = y3/3. The two equations together 
represent the system in the feedback form of Figure 7.1. The describing function of 
p(y) = y9/3 is given by 


G(s) = 


V(a) = =| (asin 9) sin @ d6 = io 


The function G(jw) can be written as 


_ jew[(1 - w?) + jew] 


CG) = (1 — w?)? + &u? 


n 
e ia La P ica da and ama = 
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The equation Im{G(jw)] = 0 yields w(1 — w?) = 0; hence, there is a unique positive 
solution w = 1. Then, 
1+ W(a)Re[G(j)] 20 > a=2 


Therefore, we expect that Raleigh’s equation has a periodic solution of frequency 
near 1 rad/sec and that the amplitude of oscillation in z is near 2. A 


For higher-order transfer functions, solving the harmonic balance equation (7.29) 
analytically might be very complicated. Of course, we can always resort to numerical 
methods for solving (7.29). However, the power of the describing function method is 
not in solving (7.29) analytically or numerically; rather, it is the graphical solution 
of (7.29) that made the method popular. Equation (7.29) can be rewritten as 


1 


or 1 l 
aga 9 (7.34) 


Equation (7.33) suggests that we can solve (7.29) by plotting the Nyquist plot o. 
G(jw) for w > 0 and the locus of -1 /' (a) for a > 0. Intersections of these loci give 
the solutions of (7.29). Since (a) is real for odd nonlinearities, the locus of —1/¥(a) 
in the complex plane will be confined to the real axis. Equation (7.34) suggests a 
similar procedure by plotting the inverse Nyquist plot of G(jw) (that is, the locus in 
the complex plane of 1/G(jw) as w varies) and the locus of =Y (a). The important 
role of Nyquist plots in classical control theory made this graphical implementation 
of the describing function method a popular tool with control engineers as they 
faced nonlinearities. 

Example 7.12 ‘Consider again the transfer function G(s) of Example 7.9. The 
Nyquist plot of G(jw) is shown in Figure 7.17. It intersects the real axis at (~1/6, 0). 
For odd nonlinearities, (7.29) will have a solution if the locus of —1/(a) on the 
real axis includes this point of intersection. A 


Let us turn now to the question of justifying the describing -function method. 


Being an approximate method for solving the infinite-dimensional equation (7.20), 
the describing function method can be justified by providing estimates of the error 
caused by the approximation. In the interest of simplicity, we will pursue this 
analysis only for nonlinearities with the following two features:? 


e Odd nonlinearity, that is, y(y) = —V(—y), V y #0. 
e Single-valued nonlinearity with a slope between a and 6; that is, 
aly - n) € (v2) ~ Yan) < Bly2 — y) 


for all real numbers y; and y2 > yı- 


POE 
See [24], [129], and [189] for describing function theory for more general nonlinearities. 
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0.05 


-0.1 
-02 -01 0 


Figure 7.17: Nyquist plot for Example 7.12. 


A nonlinearity (+) with these f 

y } eatures belongs to a sector 
oe in ee its describing function satisfies a < W(a) < £ AME grs 
` = ee owever, that the slope restriction is not the same as the ictor ipiius 
Sis enh dea F PARE slope restriction with bounds a and B. and 
with di a B ize. 
ou peta eect erent bounds à and 5. We emphasize that 


boundaries à and Â. we should use the slope bounds œ and 2, not the sector 


Example 7.13 Consider the piecewise-linear odd nonlinearity 


V forO< y<2 
wy) = 4 4-y, for2<y<3 
y— 2, fory > 3 


shown in Figure 7.18. The nonlinearity satisfies the slope restriction 


Li e Yn) - vin) 


« 
yon $1 


as well as the sector condition 


vi) 


« 9M <1 
y 


In the forthcoming analysis, we should take a = —1 and 8 —1 


&] — 


^ 
Wi : ; 
d Sur attention to the question of the existence of half-wave symmetri 
us aa und : e: is, periodic solutions that only have odd harmonics This 
estriction in view of the odd symmet i | 
ry of j. The Four i 
ai = jer coefficients 


n letion | 
This restriction is made only for convenience. See 


not make this assumption [128] for a more general analysis t 
ption. lysis that does 


į 


"E 


Besse een er 


Figure 7.18: Nonlinearity of Example 7.13. 


the phase of the first harmonic is zero; that is, y(t) = asinwt. Thus, 


y(t) = asinwt + yp (t) 


P(y(t)) are 
01 = fall 
2j 
w T/w 
Eam : S(asinut + ys(t)) exp(- jut) dt 


From (7.20), with k = 1, we have 
G(ju)ei +a, =0 


Introducing the function 


ay 


we can rewrite the equation as 


e 


1 » 
Gus (a yn) =0 


Adding V(a) to both sides of (7.35), we can rewrite it as 


1 
aga a) = ov 
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of the odd harmonics of a periodic solution y(t) satisfy (7.20) for k = 1,3,5,.... 
ae basic idea of the error analysis is to split the periodic solution y(t) into a first 
armonic yi(t) and higher harmonics yn(t). We choose the time origin such that 


Using this representation, the Fourier coefficients of the first harmonic of y(t) and 
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Figure 7.19: Finding p(w). 


where 
ôt = V(a) — V*(a, yn) 


When yn = 0, V*(a,0) = V(a). Thus, 49V = 0 and (7.36) reduces to the harmonic 
balance equation 


14 8a) =0 (7.37) 


G(jw) 


Therefore, the harmonic balance equation (7.37) is an approximate version of the 
exact equation (7.36). The error term 6 cannot be found exactly, but its size can 
often be estimated. Our next step is to find an upper bound on 6W. To that end, 
let us define two functions p(w) and o(w). Start by drawing the locus of 1/G(jw) 
in the complex plane. On the same graph paper, draw a (critical) circle with the 
interval [—8, —a] on the real axis as a diameter. Notice that the locus of —W(a) lies 
inside this circle on the real axis, since a € VW(a) < 8. Now consider an w such that 
the points on the locus 1/G corresponding to kw (k > 1 and odd) lie outside the 
critical circle, as shown in Figure 7.19. The distance from any one of these points 
to the center of the critical circle is 


hr gee ee 
2 G(jkw) 
Define 
gx. t © (78) 


p(w) = ete 2 t G(jkw) 


Note that we have defined p(w) only forw at which 1/G(jkw) lies outside the critical 
circle for all k = 3,5,...; that is, for w in the set 


0 = {w | pw) > $(8-a)} 
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On any connected subset Q’ of 2, define 
(7.39) 


The positive quantity o(w) is an upper bound on the error term oU, as stated in 
the next lemma. 


Lemma 7.1 Under the stated assumptions, 


epee s 2c(w)a ]? ; 

- 40 

e Rw aes (FER), voen (1.40) 
ôT] < olw), Ywen i (7.41) 


Proof: See Appendix C.13. 


The proof of Lemma 7.1 is based on writing an equation for y, (t) in the form 
yn = T(yn) and showing that T(-) is a contraction mapping. This allows us to 
calculate the upper bound of (7.40), which is then used to calculate the upper 
bound of (7.41) on the error term. The slope restrictions on the nonlinearity 1) are 
used in showing that T(-) is a contraction mapping. 

Using the bound of (7.41) in (7.36), we see that a necessary condition for the 
existence of a half-wave symmetric periodic solution with w € f?! is 


ERE + V(a) € ow) 


G(jw) 


Geometrically, this condition states that the point — V (a) must be contained in a 
circle with a center at 1/G(jw) and radius o(w). For each w € 1 C Q, we can 
draw such an error circle. The envelope of all error circles over the connected set 
Q forms an uncertainty band. The reason for choosing a subset of Q is that, as w 
approaches the boundary of Ñ, the error circles become arbitrarily large and cease 
to give any useful information. The subset N should be chosen with the objective 
of drawing a narrow band. If G(jw) has sharp low-pass filtering characteristics, the 
uncertainty band can be quite narrow over SY. Note that p(w) is a measure of the 
low-pass filtering characteristics of G(jw); for the smaller |G(jkw)| for k > 1, the 
larger p(w), as seen from (7.38). A large p(w) results in a small radius o(w) for the 
error circle, as seen from (7.39). 

We are going to look at intersections of the uncertainty band with the locus 
of —W(a). If no part of the band intersects the —¥(a) locus, then clearly (7.36) 
has no solution with w € 9’. If the band intersects the locus completely, as in 
Figure 7.20, then we expect that there is a solution. This is indeed true, provided 


Figure 7.20: A complete intersection. 


we exclude some degenerate cases. Actually, we can find error bounds by examining 

the intersection. Let a; and az be the amplitudes corresponding to the intersections 

of the boundary of the uncertainty band with the —U(a) locus. Let wı and wg be 

the ane vella rie to the error circles of radii o(w;) and o(w2), which 

are tangent to the —V(a) locus on either side of it. Defi i 

bbs ne a rectangle I in the 
"V T= {(w,a) |w <w <w, a «a«as) 


The rectangle T contains the point (ws,as) for which the loci of 1/G and —W 
intersect, that is, the solution of the harmonic balance equation (7.37). It turns out 
that if certain regularity conditions hold, then it is possible to show that (7.36) has 
a solution in the closure of T. These regularity conditions are l 


d d 
lv em i 
Prha G] m #0; T In[G(jw)] My #0 
A complete intersection between the uncertaint 
y band and the —®(a) locus can 
now be precisely defined as taking place when the 1/G(jw) locus d the 
—¥(a) locus and a finite set T can be defined, as shown, such that (Ws, aa) is the 
ae bags aiu in T and the regularity conditions hold. 
inally, notice that at high frequencies for which all harmonics (i i 
s (including the 
first) have the corresponding 1/G(jw) points outside the critical ids we do not 
need to draw the uncertainty band. Therefore, we define a set 


à= fu EA g B-a 


- E G(ku) - ra k= 1,3,5,...} 
and take the smallest frequency in €) as the largest. fr in Q 

, frequ 
w until the error circles become uncomfortably oe sera 


The next theorem on the justi i ibi 
! justification of the describin: i i 
main result of this section. ere ee 
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Theorem 7.4 Consider the feedback connection of Figure 7.1, where the nonlin- 
earity /(-) is memoryless, time invariant, odd, and single valued with slopes between 
a and B. Draw the loci of 1/G(jw) and —W(a) in the complez plane and construct 
the critical circle and the band of uncertainty as described earlier. Then, 


Critical clrcle 


uncertalnty 


e the system has no half-wave symmetric periodic solutions with fundamental 
frequency w € (1. . 


e the system has no half-wave symmetric periodic solutions with fundamental 
frequency w € M if the corresponding error circle does not intersect the —W(a) 
locus. 


TATEM MÀ s 
ie PAIS A dna * * + * d ve A i 
eu ete ed tae iem oL, US Be us 


e for each complete intersection defining a set l' in the (w, a) plane, there is at 
least one half-wave symmetric periodic solution 


m 


y(t) = asinwt + ys(t) 
1G( o) 


with (w,a) in T and y,(t) satisfies the bound of (7.40). o 


Proof: See Appendix C.14. 


-1.2 -1 -0.8 -0.6 -0.4 -0.2 0 0.2 


"n Note that the theorem gives a sufficient condition for oscillation and a suffi- 
E: cient, condition for nonoscillation. Between the two conditions, there is an area of 
^ ambiguity where we cannot reach conclusions of oscillation or nonoscillation. 


Figure 7.21: Uncertainty band for Example 7.14. 


and a = 1.539. The error circle corresponding to w = 2.85 is almost tangent to the 
real axis from the lower side, so we take wa = 2.85. The error circle corresponding 
to.w = 2.8 is the closest circle to be tangent to the real axis from the upper side. 
This means that w; > 2.8. Trying w = 2.81, we have obtained a circle that is almost 
tangent to the real axis. Therefore, we define.the set I’ as 


Example 7.14 Consider again 


-8 . 
BOIS 8? +0.83 4-8 


together with the saturation nonlinearity. We have seen in Example 7.10 that the 

harmonic balance equation has a unique solution w, = 2V2 = 2.83 and a, = 1.455. 

The saturation nonlinearity satisfies the slope restrictions with a = 0 and BH=1. 

Therefore, the critical circle is centered at —0.5 and its radius is 0.5. The function 
^ — 1/G(jw) is given by 


T = {(w,a) | 2.81 < w < 2.85, 1.377 < a < 1.539) 


There is only one intersection point in. We need to check the regularity conditions. 


i "NU The derivative 
,oO-W 
GGw) 0.8+ j 
Hence, the locus of 1/G(jw) lies on the line Re[s] = —0.8, as shown in Figure 7.21. 
The radius of the error circle o(w) has been calculated for eight frequencies starting 
* with w = 2.65 and ending with w = 3.0, with uniform increments of 0.05. The 
centers of the error circles are spread on the line Re[s] = —0.8 inside the critical 
circle. The value of o(w) at w = 2.65 is 0.0388 and at w = 3.0 is 0.0321, with 
monotonic change between the two extremes. In all cases, the closest harmonic to 
the critical circle is the third harmonic, so that the infimum in (7.38) is achieved at 
k = 3. The boundaries of the uncertainty band are almost vertical. The intersection 
of the uncertainty band with the —W(a) locus correspond to the points a, = 1.377 


is different from zero at a = 1.455, and 
| d : EE 40 
tmel] = pa 


Thus, by Theorem 7.4, we conclude that the system indeed has a periodic solution. 
Moreover, we conclude that the frequency of oscillation w belongs to the interval 
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Figure 7.22: Inverse Nyquist plot and critical circle for Example 7.15. 


[2.81, 2.85], and the amplitude of the first harmonic at the input of the nonlinearity 
belongs to the interval [1.377, 1.539]. From the bound of (7.40), we know also that 
the higher harmonic component yi (t) satisfies 


w parle 
= ji y2(t) dt < 0.0123, V (w,a) €T 
n 


which shows that the waveform of the oscillating signel at the nonlinearity input is 
fairly close to its first harmonic asinwt. A 


Example 7.15 Reconsider Example 7.9 with 


1 


G(s) = viriys2) 


and the saturation nonlinearity. The nonlinearity satisfies the slope restriction with 
à = 0 and B = 1. The inverse Nyquist plot of G(jw), shown in Figure 7.22, lies 
outside the critical circle for all w > Hence, 9 = (0,00), and we conclude that 
there is no oscillation. A 


7.3 Exercises 


7.1 Using the circle criterion, study absolute stability for each of the scalar transfer 
functions given next. In each case, find a sector [a,(] for which the system is 
absolutely stable. 

Q Gea 
vo gt s+ 
1 


2) 997613633) 
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7.2 Consider the feedback connection of Figure 7.1 with G(s) = 2s/(s? + s + 1). 
(a) Show that the system is absolutely stable for nonlinearities in the sector (0, 1]. 
(b) Show that the system has no limit cycles when p(y) = sat(y). 

7.3 Consider the system 

å = ~z; — h(x, + 22), $9 zi — 23 — 2h(ay + x2) 


where h is a smooth function satisfying 


: ox C y 2 a 
yh(y) 2 0, V y'E R, w=] o We a 
=c y S -a 


lh(y.Sc for ay <y<a, and -a; «y« ~a; 
(a) Show that the origin is the unique equilibrium point. 
(b) Show, using the circle criterion, that the origin is globally asymptotically stable. 
7.4 ([201]) Consider the system 


£i-1:2, — $2 —(u?*-- a? — qcoswt)xy ~ 2uzs 


Piani es s 1 w are positive constants. Represent the system in the form of 
A ; he vy) = qy cos wt and use the circle criterion to derive conditions 
H, a, q, and w, which ensure that the origin is exponentially stable. 


7.5 Consider the linear time-varyi i | 

C ying system Z = [A + BE(t)C]z, where A i 
ER lEz S1, Vt 2 0, and sup er omax(C(jwl — pe 1 Show hat 
the origin is uniformly asymptotically stable. : 
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7.6 Consider the system + = Az + Bu and let u = —Fz be a stabilizing state 
feedback control; that is, the matrix (A — BF) is Hurwitz. Suppose that, due to _ 
physical limitations, we have to use a limiter to limit the value of v; to [u;(t)| < L. 
The closed-loop system can be represented by $ = Az ~ BL sat(Fx/L), where 
sat(v) is a vector whose ith component is the saturation function. 


(a) Show that the system can be represented in the form of Figure 7.1 with G(s) = 
F(sI — A+ BF)^! B and #(y) = L sat(y/L) — y. 


(b) Derive a condition for asymptotic stability of the origin using the multivariable 
' circle criterion. 


(c) Apply the result to the case 


0 1 0 
II fs a«|1]. F=(1 2], and L=1 


and estimate the region of attraction. 
7.7 Repeat Exercise 7.1 using the Popov criterion. 


7.8 In this exercise, we derive a version of the Popov criterion for a scalar transfer 
function G(s) with all poles in the open left-half plane, except for a simple pole on 
the imaginary axis having a positive residue. The system is represented by 


z= Az-Byly), $2-w(y, and y=Cz+du 
where d > 0, A is Hurwitz, (A, B) is controllable, (A,C) is observable, and 7 
belongs to a sector (0, k]. Let V(z,v) = 27Pz+a(y — Cz)? +b ff Yle) do, where 
P= PT >0,a>0, and b » 0. 
(a) Show that V is positive definite and radially unbounded. 
(b) Show that V satisfies the inequality 
V « zT (PA ATP)z - 221 (PB — w)p(y) - v? (y) 


where w = adCT + (1/2)bATCT and y = (2ad/k) + b(d + CB). Assume b is 
chosen such that y > 0. 


(c) Show that the. system is absolutely stable if 
1 ; "E. 
i + Re[(14- jwn)G(jw)| » 0, Vu € nR, whereg = od 


7.9 ([85]) The feedback system of Figure 7.23 represents a control system where 
H(s) is the (scalar) transfer function of the plant and the inner loop models the 
actuator. Let H(s) = (s + 6)/(s + 2)(s + 3) and suppose k > 0 and v» belongs to a 
sector (0, 6], where £ could be arbitrarily large, but finite. 
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(a) Show that the system can be represented as the feedback connection of Fig- 
ure 7.1 with G(s) = [H (s) + k]/s- 


(b) Using the version of the Popov criterion in Exercise 7.8, find a lower bound ke 
such that the system is absolutely stable for all k > ke. 


Figure 7.23: Exercise 7.9.. 


7.10 For each odd nonlinearity (y) on the following list, verify the given expres- 
sion of the describing function V(a): 


(1) vy) = s; YV(a)-5a/8 
(2) vy) = wl Ela) =32a°/15m 

4A 
(8) w(y) : Figure 7.24(a); Wa) =k +E 


(4) p(y) : Figure 7.24(b) 


0, fora<A 
we) = lusjon- (Aj PA, fore A 
(B) p(y) : Figure us -— 
= k[1 — N (a/A)]; for A<a<B 
2E | k(N G/B) = N(a/A)) fora > B 


need fer) | 


7.11 Using the describing function method, investigate the — hana 
solutions and the possible frequency and amplitude of oscillation in the 
connection of Figure 7.1 for each of the following cases: 


7 » etre om, at dt s a ar, ii a asin 
-——— M 
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v(y), \slope = & 


ABY 


(c) 


Figure 7.24: Exercise 7.10. 


(1) G(s) = (1— s)/s(s + 1) and V(y) = 3°. 


(2) G(s) = (1 — s)/s(s + 1) and v is the nonlinearity of Exercise 7.10, part (5), 
with A = 1, B = 3/2, and k — 2. 


(3) G(s) =1/(s+1)8 and (y) = sgn(y). 
(4) G(s) = (s+6)/s(s + 2)(s +3) and p(y) = sgn(y). 
(8) G(s) = s/(s? — s +1) and $(y) = y". 


(6) G(s) = 5(s + 0.25)/s?(s + 2)? and v is the nonlinearity of Exercise 7.10, part 
(3), with A — 1 and k = 2. , 


(7) G(s) =5(s + 0.25)/s?(s + 2)? and y is the nonlinearity of Exercise 7.10, part 
(4), with A=1 and B — 1. 


(8) G(s) = 5(s + 0.25) /s?(s + 2)? and «j is the nonlinearity of Exercise 7.10, part 
(5), with A= 1, B = 3/2, and k = 2. 


(9) G(s) 5 1/(s + 1)8 and $(y) = sgn(y). 
(10) G(s) =1/(s + 1)* and p(y) = sat(y). 


7.12 Apply the describing function method to study the existence of l periodic 
solutions in the negative resistance oscillator of Section 1.2.4 with h(v) = ~u +v — 
v5/5 and € = 1. For each possible. periodic solution, estimate the frequency and 
amplitude of oscillation. Using computer simulation, determine how accurate the 
describing function results are. 

7.13 Consider the feedback connection of Figure 7.1 with G(s) = 2bs/(s? —bs+ 1) 
and y(y) = sat(y). Using the describing function method, show that for sufficiently 
small b > 0 the system has a periodic solution. Confirm your conclusion by applying 
Theorem 7.4 and estimate the frequency and amplitude of oscillation. 
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7,14 Consider the feedback connection of Figure 7.1 with 


1 by -1 sS by < 1 
G(s) = Gaeta” ply) = 


where b > 0. 


sgn(y) by » 1 


(a) Using the circle criterion, find the largest b for which we can confirm that the 
origin of the closed-loop system is globally asymptotically stable. 


(b) Using tlie Popov criterion, find the largest b for which we can confirm that the 
origin of the closed-loop system is globally asymptotically stable. 


(c) Using the describing function method, find the smallest b for which the System 
will oscillate and estimate the frequency of oscillation. 


(d) For b — 10, study the existence of periodic solutions by using Theorem 7.4. For 
each oscillation, if any, 


i. find the frequency interval [w;, w2] and the amplitude interval [21, a2); 


ii. use Lemma 7.1 to find an upper bound on the energy content of the higher- 
. order harmonics and express it as a percentage of the energy content of 
the first harmonic; and 


iii. simulate the system and compare the simulation results with the foregoing 
‘analytical results. : 


(e) Repeat part (d) for b — 30. 
7.15 Repeat parts (a) to (c) of the previous exercise for G(s) = 10/ (s-- 1)*(s - 2). 


7.16 Consider the feedback connection of Figure 7.1, where G(s) = 1/(s + 1)? 


and (y) is the piecewise-linear function of Figure 7.15 with ó = 1 Jk, $1 = k, and 
$2 = 0. 


(a) Using the describing function method, investigate the existence of periodic 
solutions and the possible frequency and amplitude of oscillation when k z 10. 


(b) Continuing with k = 10, apply Theorem 7.4. For each oscillation, if any, find 
the frequency interval [w1,w2] and the amplitude interval [a;, az]. 


(c) What is the largest slope k > 0 for which Theorem 7.4 ensures that there is no 
oscillation? 


7.17 For each of the following cases, apply Theorem 7.4 to study the existence of 
periodic solutions in the feedback connection of Figure 7.1, For each oscillation, if 
any, find the frequency interval [w,w2] and the amplitude interval [a1, a2]. 


i 
1 
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(1) G(e) = 2(s ~ 1)/s*(s + 1) and Wy) = sat(y). 


(2) G(s) = —s/(s? + 0.8s +8) and vy) = (1/2) siny. 
(8) G(s) = —s/(s? 


+ 0.89 + 8) and V(y) is the nonlinearity of Example 7.13. 
(4) G(s) = —24/s (s + 1)? and p(y) 


is an odd nonlinearity defined by 
3 

V t y/2, 
vV(y) = 


2y — 1/2, 


forO<y<1 


for y > 1 


Chapter 8 
Advanced Stability Analysis 


In Chapter 4, we gave the basic concepts and tools of Lyapunov stability. In this 
` chapter, we examine some of these concepts more closely and present a number of 
extensions and refinements. 


We saw in Chapter 4 how to use linearization to study stability of equilibrium 
points of autonomous systems. We saw also that linearization fails when the Ja- 
cobian matrix, evaluated at the equilibrium point, has some eigenvalues with zero 
real parts and no eigenvalues with positive real parts. In Section 8.1, we introduce 
the center manifold theorem and use it to study stability of equilibrium points of 
autonomous systems in the critical case when linearization fails. 

The concept of the region of attraction of an asymptotically stable equilibrium 
point was introduced in Section 4.1. In Section 8.2, we elaborate further on that 
concept and present some ideas for providing estimates of this region. 

LaSalle’s invariance principle for autonomous systems is very: useful in applica- 
tions. For a general nonautonomous system, there is no invariance principle in the 
same form that was presented in Theorem 4.4. There are, however, theorems which 
capture some features of the invariance principle. Two such theorems are given in 
Section 8.3. The first theorem shows convergence of the trajectory to a set, while 
the second one shows uniform asymptotic stability of the origin. 


Finally, in Section 8.4, we introduce notions of stability of periodic solutions and 
invariant sets. 


8.1 The Center Manifold Theorem 
Consider the autonomous system 


å = f(z) (8.1) 


where f : D — R* is continuously differentiable and D C R” is a domain that 
contains the origin z = 0. Suppose that the origin is an equilibrium point of (8.1). 
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‘Theorem 4.7 states that if the linearization of f at the origin, that is, the matrix 


_ teed 


has all eigenvalues with negative real parts, then the origin is asymptotically stable; 
if it has some eigenvalues with positive real parts, then the origin is unstable. If 
A has some eigenvalues with zero real parts with the rest of the eigenvalues having 
negative real parts, then linearization fails to determine the stability properties of 
the origin. In this section, we take a closer look into the case when linearization 
fails. Failure of linearization leaves us with the task of analyzing the nth-order 
nonlinear system (8.1) in order to determine stability of the origin. The interesting 


T 


finding that we are going to present in the next few pages is that stability properties 
of the origin can be determined by analyzing a lower order:nonlinear system — a: 


system whose order is exactly equal to the. number of eigenvalues of A with zero 
real parts. ‘This will follow as an application of the center manifold theory. 

"A k-dimensional manifold in R” (1 < k < n) has a rigorous mathematical 
definition.? For our purpose here, it is sufficient to think of a k-dimensional manifold 
as the solution of the equation : 

n(x) =0 


where 7: R” — R?-* is sufficiently smooth (that is, sufficiently many times con- 
tinuously differentiable). For example, the unit circle 


(re R | 2? +23 =1} 
is a one-dimensional manifold in R?. Similarly, the unit sphere 
n 
{re R" | ys =1} 
i=l 


is an (n — 1)-dimensional manifold in R”. A manifold (n(x) = 0} is said to be an 
invariant manifold for (8.1) if : 


nfa(0)) = 0 = n(z() 20, Vt € [0,41) CR 


where [0, t1) is any time interval over which the solution z(t) is defined. 
Suppose now that f(x) is twice continuously differentiable. Equation (8.1) can 
be represented as : ' 


b= Art [ro - Lo) | - As (s) 


'The center manifold theory has several applications to dynamical! systems. It is presented here 
only insofar as it relates to determining the stability of the origin. For a broader viewpoint of the 
theory, the reader may consult (34]. 

?See, for example, [71]. 


-all eigenvalues of A, have:zero real. parts, .and. all eigenvalues.of'Aj:have negative real 
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where 2t utet 
ft) - fe) LOs 


- is twice continuously differentiable and 


ives Hcl five 
f(0) — 0; 5,0) 70 


» 


Since our interest is in the case when linearization fails, assume that A has k eigen- 


values with zero real parts and m = n — k eigenvalues. with negative real parts. ' 


We can always find a similarity transformation T that transforms A int: 
\ ransforms A 
diagonal matrix, that is, DOE 
TaT = | H | 


0. Ag 


where all eigenvalues of 4; have zero. real parts and all eigenvalues of Ag: have: 


negative Teal parts. Clearly, A, is k x k and Az is m x m. The change of variables 
| : | =Tr; ye R"; ze R” 


transforms (8.1) into the form 


=. Aiit oly, z): (8.2) 
„Aaz + ga(y,z) i (8.3) 


where g1 and 9» inherit properties of f. In particul i i 
Hou dae ) f particular, they are twice continuously 


P 


Ógi 09; 
;(0,0) =0;, 2% =o 2% = 
g ( 0) 0; Oy (0, 0) 0; Oz (0, 0) =0 (8.4) 


for i = 1,2. If z = A(y) is an invariant manifold fi - i 
then it is called a center manifold if Pre ene AS; 


h(0) = 0; 5,0 -0 


Theorem 8.1 Jf g, and gz are twice continuously. differentiabie and: satisfy (8.4) 


parts, then there exist a constant 6 >.0:and:a: continuously differentiable: Rinotop 
; ' > stant 0 >U: ana:a.continuously:differentiable: function: 

h(y), defined for all |yl| < 5, such that z = h(y).is a center manifold for (5283) 
o 


Proof: See Appendix C.15. 


If the initial state of the system (8 2)-(8.3) lies i i 
d .2)-(8. in the center manifold; that i 
2(0) = h(y(0)), then the solution (y(t), z(£)) will lie in the manifold for all £ a 
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that is, z(t) = h(y(t)). In this case, the moti i 
3 iz . , tion of the system in th t i 
is described by the kth-order differential equation 2 d d ne 


dF Ay tony, h(y)) (8.5) 
which we refer to as’ the. reduced system. If z(0) # h(y(0)), then the difference 


z(t) — h(y(t)) represents the deviation of the traj 
à ectory from th i 
any time f. The change of variables : TENES ee near 


HET 


= Aud g(ywh(y) (8.6) 
Aalu + h(y)] + gafy + h(a) - To [Ary + giy, w + h(y))] (8.7) 


transforms (8.2)-(8.3) into 


w 


It 


In the new coordinates the center mani =U. 
, fold IS W fo. 
0 The motion in the mani ld 


w(t) 0 > w(t) 0 


Substituting these identities into (8.7) results in 


0 = Ash(y) + g2(y, h(y)) — o) [Ary + 92(y, h(9))] (8.8) 


Since the equation must be satisfied b i ies i 

) ; y any solution that lies in the center mani- 
re ^ re that the function h(y) must satisfy the partial differential equation 
f . , ding and subtracting gi(y, h(y)) to the right-hand side of (8.6), and sub- 
racting (8.8) from (8.7), we can rewrite the equation in the transformed coordinates 


ù = Auyctgn(yh(y)- Ny w) (8.9) 
w = Awt N (y, w) (8.10) 
where 
M(y,w) = ily, w + h(y)) — arly, h(y)) 
and 


Na(y,w) = galv, w + h()) — go (y, h(y)) — 5,0) N, (y, u) 


It is not difficult to verify that Ni and Ne are twice continuously differentiable, and 


ON; 
Ni(y,0) =0; (0,0) = 
“o=o 54(0,0) =0 
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for i = 1,2. Consequently, in the domain 


| y 


N, and Ns satisfy 

INi(y, w)lla S killwll; += 1,2 
where the positive constants kı and kz can be made arbitrarily small by choosing 
p small enough. These inequalities, together with the fact that Az is Hurwitz, 
suggest that the:stability properties-of.the origin are determined by the reduced 


"system (8.5). The next theorem, known as the reduction principle, confirms this 


conjecture. 


. Theorem 8.2 Under thé assumptions ‘of Theorem 8.1, if the origin y = 0 of the 


reduced system (8.5) is asymptotically stable (respectively, unstable) then the origin 
of the full system (8.2) and-(8:3) is also asymptotically stable (respectively, unstable). 
o 


Proof: The change of coordinates from (y, z) to (y, w) does not change the stability 
properties of the origin (Exercise 4.26); therefore, we can work with the system (8.9) 
'and (8.10). If the origin of the reduced system (8.5) is unstable, then, by invariance, 
the origin of (8.9) and (8.10) is unstable. This is so because for any solution y(t) 
of (8.5), there is & corresponding solution (y(t), 0) of (8.9) and (8.10). Suppose 
now that the origin of the reduced system (8.5) is asymptotically. stable. By (the 
converse Lyapunov) Theorem 4.16. there is a continuously differentiable function 
V(y) that is positive definite and satisfies the inequalities 


OV ' . 
ay AY + gy, h(y))] € —a3(llyll2) 


oV 

| <aa(llylle) € k 
|o], < as) 
in a neighborhood of the origin, where o and o4 are class K functions. On the 
other hand, since Ag is Hurwitz, the Lyapunov equation 

PA; + ATP = -I 
hes a unique positive definite solution P. Consider 
v(y, w) = V(y) + VuT Pw 


as a Lyapunov function candidate? for the full system (8.9) and (8.10). The deriva- 
tive of v along the trajectories of the system is given by 


b(y,w) = oe Any + nly, h(y)) + Nay, w)] 


3The function v(y,w) is continuously differentiable everywhere around the origin, except on 
the manifold w = 0. Both v(y,w) and ù(y, w) are defined and continuous around the origin. It 
can be easily seen that the statement of Theorem 4.1 is stil) valid. 
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1 T T T 
+ — lu (PA + AP P)w + 2w! PNa(y, w)) 
Wut Pw 1 


llla kaàmax(P) 


—a3(|lyl]2) + kkilhwlla — aP + aP. 
-os(lill) ~ eph -— 


1 Aes (P) , 
—— 9A kk d RA | Nelle 
4 Amax(P) ? min (P) 


Since kı and kz can be made arbitrarily small by restricting the domain around the 
origin to be sufficiently small, we can choose them small enough to ensure that 


t eae kk, — p, Ames P) 
44 Amax (P) v Amin (P) 


1A 


>0 


Hence, 


oy, w) € ~as(([yll2) s oil 


which shows that r(y, w) is negative definite. Consequently, the origin of the full 
system (8.9)-(8.10) is asymptotically stable. a 


We leave it to the reader (Exercises 8.1 and 8.2) to extend the proof of Theo- 
rem 8.2 to prove the next two corollaries. ' 


Corollary 8.1 Under the assumptions of Theorem 8.1, if ihe origin y — 0 of the 
reduced system (8.5) is stable and there is a continuously differentiable Lyapunov 
function V(y) such that 4 


A MAR) «0 


in some neighborhood of y = 0, then the origin of the full system (8.2)-(8.3) is 
stable. : o 
Corollary 8.2 Under the assumptions of ‘Theorem 8.1, the.origin of the reduced 
system (8.5) is, asymptotically stable if and only if the origin of the full system 
(8.2)-(8.3) is asymptotically stable. l o 


*The existence of the Lyapunov function V(y) cannot be inferred from a converse Lyapunov 
theorem. The converse Lyapunov theorem for stability [72, 107) guarantees the existence of à 
Lyapunov function V (1, y) whose derivative satisfies V(t, y) € 0. In general, this function cannot be 
made independent of t. (See (72, page 228].) Even though we can choose V (t, y) to be continuously 
differentiable in its arguments, it cannot be guaranteed that the partial derivatives 9V/Oy;,, OV/Ot 
will be uniformly bounded in a neighborhood of the origin for all £ > 0. (See [107, page 53].) 
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ees ` b s. 


To use Theorem 3.2, we need to find the center manifold z = h(y). The function 
h is a solution of the partial differential equation ee 


N(h(y)) EE [Ay (us hE Azha) =ge(vsh(y))=0. (811) 
with boundary conditions S 
(0) = 0; (0) 0- (8.12) 


that a solution of the full system (8.2)-(8.3) has been found), but its solution can: 


hly) — é(y) = O(|lyl|”) 


and the reduced system can be represented as’ 
i= Aw nd) + Ollu P+); 
i © 


Proof: See Appendix C.15. 


The order of magnitude notation O(-) will be formally introduced in Chapter 10 
(Definition 10.1). For our purpose here, it is enough to think of f (y) = O(|}yll?) 
as a shorthand notation for || f(y)ll < kllylP for sufficiently small |||. Let us now: 
illustrate the application of the center manifold theorem by examples. In the first- 
two examples, we will make use of the observation that for a scalar state equation 
of the form 


ELI + o (lylP**) iupar 
where p is a positive integer; the origin is asymptotically. stable if p:is odd.and 
a « 0. It'is unstable if p is odd and a > 0, or p is even anda 09 — 


Example 8.1 Consider the system 
i = 2 
$9 = ~t + az? + brit 


Where a tg 0. The system has a unique equilibrium point at the origin. The 
linearization at the origin results in the matrix 


4=[0 4] 


58ee Exercise 4.2. 


eigenvectors of A; that is, ^: 


ula a] 


puts the system into the form 
ý = alyt+z)? ~b(yz +27) 
à = -z-aly+2z)? + b(yz+ 27) 
The center manifold equation (8.11) with the boundary condition (8.12) becomes 


N(h(y)) = R'()fa(y + A(y))? — kyh(y) + h*(y))] + h(y) 
* e(y + h(y))? = b(yh(y) + h*(y)) 20, (0) = h/(0) =0 


f approximation h(y) œ 0. The reduced system is 
ya wl y= ay? + O(lyP*) 


Notice that an O(|y|?) error in A(y) results in an O([y[3) error in the right-hand side 
of the reduced system. This is a consequence of the fact that the function gn 2), 
which appears on the right-hand side of the reduced system (8.5) as gi(y, h(y)) 
has a partial derivative with respect to z that vanishes at the origin. Clearly, this 
observation is also valid for higher order approximations; that is, an error of order 
O(|y|*) in (y) results in an error of order O(|y|**) in gi (y, h(y)), for k > 2. The 
term ay? is the dominant term on the right-hand side of the reduced system. For 
a #0, the origin of the reduced system is unstable. Consequently, by Theorem 8.2 
the origin of the full system is unstable. ^ 
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^ which has eigenvalues at 0 and —1. Let M be a matrix whose columns are the’ 


a) 
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Example 8.2 Consider the system 


which is already represented in the (y, z) coordinates. The center manifold equation 


p thy y 
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yz 
à = ~z+a o: 


(8.11) with the boundary condition (8.12) is 
h’'(y)[yh(y)] + h(y) - ay? =0, R(0) = R'(0) = 0 
We start by trying ¢(y) = 0. The reduced system is 
hig) A y- oy) 


Clearly, we cannot reach any conclusion about the stability of the origin, Therefore, 
we substitute h(y) = hay? + O(|y|*) into the center manifold equation and calculate 
hg, by matching coefficients of y?, fo obtain ha = a. The reduced system is 


yay’ +O(lyl*) 7 


Therefore, the origin is asymptotically stable if a < 0 and unstable if a > 0. Conse- 
quently, by Theorem 8.2, we conclude that the origin of the full system is asymptot- 
ically stable if a < 0 and unstable if a > 0. If a = 0, the center manifold equation 
(8.11) with the boundary condition (8.12) reduces to 


h'(y)[yh(y)] + h(y) = 0, h(0) = A'(0) = 0 


which has the exact solution h(y) = 0. The reduced system j = 0 has a stable origin 


with V(y) = y as a Lyapunov function. Therefore, by Corollary 8.1, we conclude i 
that the origin of the full system is stable if a = 0 A » > 
H 
Example 8.3 Consider the system (8.2)-(8.3) with M 
= ' 
a=) C l|, =] 595, |, Aa -L and go = i - Vi + yita Tw 
-1 0 -yz +z ie 
It can be verified that ġ(y) = 0 results in M(¢(y)) = O (Ill) and te 
3 ie 
TEM -y ty O 4 i 
p= | 3*5 | +o e 


Using V(y) = (y? + y2)/2 as a Lyapunov function candidate, we obtain 
V = -yí — y4 +70 (lvl) € —Hlyll2 + hyhi 


ene TN 
The error on the right-hand side of the reduced system is ‘actually O([y[5) since, if we write 
h(y) = hay? + hay? +--+, we will find that hg = 0. 
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in sonie neighborhood of the origin where k » 0. Hence, 
i 1 

7 lij, 14 + 

V <- ilz. for llylle < x 


which shows that the origin of the reduced system is asymptotically stable. Conse- 
quently, the origin of the full system is asymptotically stable. A 


Notice that in the preceding example it is not enough to study the system 


3 
._ | -y+ 
NET 
yl — y» 
We have to find a Lyapunov function that confirms asymptotic stability of the origin 
for all perturbations of the order O ((ly||3). The importance of this observation is 
illustrated by the next example. 


Example 8.4 Consider the previous example, but change A; to 


With ¢(y) = 0, the reduced system can be represented as 


3 
2^ ] +c) ——- 
Y2 
Without the perturbation term O (||y||4), the origin of this system is asymptotically 
stable." If you try to find a Lyapunov function V(y) to show asymptotic stability 
in the presence of the perturbation term, you will not succeed. In fact, it can 
be verified that the center manifold equation (8.11) with the boundary condition 
(8.12) has the exact solution h(y) = y}, so that the reduced system is given by the 


Estimate of the region to t 


of attraction of x ps 


Region of attraction of x ee 


Figure 8.1: Critical clearance time. 


happen in the operation of a nonlinear system. Suppose that a nonlinear system 
has an asymptotically stable equilibrium point, which is denoted by zy, in Suppose 
the system is operating at steady state at £pr. Then, at time to a fault that changes 
the structure of the system takes place, for example, a short circuit in an electrical 
network. Suppose the faulted system does not have equilibrium points at zp, or 
in its neighborhood. The trajectory of the system will be driven away from Zpr. 
Suppose further that the fault is cleared at time t; and the postfault system has 
an asymptotically stable equilibrium point at £ps, where either rp, = pr OF Tps 
is sufficiently close to zpr so that steady-state operation at zp, is still acceptable. 
At time ¢, the state of ‘the system, say, x(t1), could be far from the postfault equi- 
librium zp.. Whether or not the system will return to steady-state operation at 
Tps depends on whether z(i;) belongs to the region of attraction of rps, as deter- 
mined by the postfault system equation. A crucial factor in determining how far 
z(t1) could be from zy, is the time it takes the operators of the system to remove 
the fault, that is, the time difference (t — to). If (£1 — tp) is very short, then, by 


equation i 
._ | EZ continuity of the solution with respect to t, it is very likely that z(t1) will be in the 
v y- ya region of attraction of rps. However, operators need time to detect the fault and fix 
i an “rial A it. How much time they have is a critical question. In planning such a system, it is 
whose origin is unstable. 


8.2 Region of Attraction. , Dowem of attraction , alticcion V 


Quite often, it is not sufficient to determine that a given system has an asymp- 
totically stable equilibrium point. Rather, it is important to find the region of 
attraction of that point, or at least an estimate of it. To appreciate the importance 
of determining the region of attraction, let us run a scenario of events that could 


7See Exercise 4.56. 
8See Exercise 4.13. 


valuable to give operators a “critical clearance time,” say te, such that they have to 
clear the fault within this time; that is, (t; — tg) must be less than te. If we know 
the region of attraction of £ps, we can find te by Figure 8.1. integrating the faulted 
system equation starting from the prefault equilibrium zpr until the trajectory hits 
the boundary of the region of attraction. The time it takes the trajectory to reach 
the boundary can be taken as the critical clearance time because if the fault is 
cleared before that time the state x(t,) will be within the region of attraction. Of 
course, we are assuming that zp, belongs to the region of attraction of Tps, which is 
reasonable. If the actual region of attraction is not known, and an estimate tse of t, 
is obtained by using an estimate of the region of attraction, then tee < te, since the 


314 . CHAPTER 8. ADVANCED STABILITY ANALYSIS 


boundary of the estimate of the region of attraction will be inside the actual bound- 
` ary of the region. (See Figure 8.1.) This scenario shows an example where finding 
the region of attraction is needed in planning the operation of a nonlinear system. 
- It also shows the importance of finding estimates of the region of attraction that 
are not too conservative. A very conservative estimate of the region of attraction 
would result in tee that is too small to be useful. Let us conclude this motivating 
discussion by saying that the scenario of events described here is not hypothetical. 
It is the essence of the transient stability problem in power systems.? 


nonlinear.system .; =" NUS 
nisus = f(z)» (8.13) 


Some properties of the region of attraction are stated in the next lemma, whose 
proof is given in Appendix C.16. ^ 
: n um [ .1 If z.— 0 is an asymptotically stable equilibrium point for (8.13), then 
its region -of-attraction -RA is: an open, connected, invariant set. Moreover, the 
boundary: of Ra is formed. by trajectories." o 


Lemma 8.1 suggests that one way to determine the region of attraction is to 
characterize those trajectories that lie on the boundary of R4. There are some 
methods that, approach the problem from this viewpoint, but they use geometric 
notions from the theory of dynamical systems that are not introduced in this book. 
Therefore, we will not describe this class of methods.!Ü We may, however, get a 
flavor of these geometric methods in the case of second-order systems (n = 2) by 
employing phase portraits. Examples 8.5 and 8.6 show typical cases in the state 
plane. In the first example, the boundary of the region of attraction is a limit cycle, 

U while in the second one the boundary is formed of stable trajectories of saddle points. 
Example 8.7 shows a rather pathological case where the boundary is a closed curve 
of equilibrium points. 


Example 8.5 The second-order system 


gg = 214+(2?-1)z2 


is a Van der Pol equation in reverse time, that is, with t replaced by —t. The system 
has one equilibrium point at the origin and one unstable limit cycle, as determined 
from the phase portrait shown in Figure 8.2. The phase portrait shows that the 


9See [170] for an introduction to the transient stability problem in power systems. 
E IO Exemples of these methods can be found in [36] and [210]. 


 Let.thie origin £= 0 be an asymptotically stable equilibrium point for the - 
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Figure 8.2: Phase portrait for Example 8.5. 


ME TUERI IS 


origin is a stable focus; hence, it is asymptotically stable. This can be confirmed by 
linearization, since 
-[1 | 
z=0 (dl 


has eigenvalues at —1/2 + jv3/2. Clearly, the region of attraction is bounded 
because trajectories starting outside the limit cycle cannot cross it to reach i 
origin. Because there are no other equilibrium points, the boundary of Ra must | e 
the limit cycle. Inspection of the phase portrait shows that indeed all trajectories 


starting inside the limit cycle spiral toward the origin. A 


RM Sth erin nce 


Example 8.6 Consider the second-order system 


ij = r2 
: 3 
do = zi 421-22 


This system has three isolated equilibrium points at (0,0), (V3,0), and d 
The phase portrait of the system is shown in Figure 8.3. The phase den s A 
that the origin is a stable focus, and the other two equilibria are saddle m S. , 
Thus, the origin is asymptotically stable and the other equilibria are unstal if a 
fact that can be confirmed by linearization. From the phase portrait, we can also ; 
see that the stable trajectories of the saddle points form two separatrices that are 


i the boundaries of the region of attraction. The region is unbounded. A ~ 
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Figure 8.3: Phase portrait for Example 8.6. 


Example 8.7 The system 


a) = -a(l - s] — 23) 
dy = ~2(1-2}- 23) 


has an isolated equilibrium point at the origin and a continuum of equilibrium points 
on the unit circle; that is, every point on the unit circle is an equilibrium point. 
Clearly, R4 must be confined to the interior of the unit circle. The trajectories of 
the system are the radii of the unit circle. This can be seen by transforming the 
system into polar coordinates. The change of variables 


zı = pcos, x2 psinó 


yields ; 
p=-p(1-p*), 6=0 


All trajectories starting with p < 1 approach the origin as t — oo. Therefore, Ra 
is the interior of the unit circle. A 


Lyapunov’s method can be used to find the region of attraction R4 or an es- 
timate of it. The basic tool for finding the boundary of R4 is Zubov's theorem, 
which is given in Exercise 8.10. The theorem, however, has the character of an 
existence theorem and requires the solution of a partial differential equation. Via 
much simpler procedures, we can find estimates of RA by using Lyapunov’s method. 
By an estimate of R4, we mean a set Q C Ra such that every trajectory starting 
in Q approaches the origin as t — co; For the rest of this section, we will discuss 
some aspects of estimating Ra. Let us start by showing that the domain D of The- 


Imp dade orem 4.1 (or Corollary 4.1) is not an estimate of Ra. We have seen in Theorem 4.1 


and Corollary 4.1 that if D is a domain that, contains the origin, and if we cen 
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find a Lyapunov function V(x) that is positive definite ‘fn Dind (ay is negutivs ? 


definite in.D or. negative .semidefinite, but. no. solution: can stay-identically:in the : 
set (V(z) = 0} except for the zero:solution z.«:0,:then the origin is asymptoti-' 
-cally stable; One. may jump to the i is an estimate . This 

conjecture js not trug, as illustrated by the next example. 


Example 8.8 Consider again the system of Example 8.6: H 
| iq = 2 
& = nom 


This system is a special case of that of Example 4.5 with 
h(zi) = 2; — 321 and a=1 


Therefore, a Lyapunov function is given by 


1 1 
2 2 x 
ve) eH es ins 


4 
ai + brir + 122 
and M 


Va) =~ tt - 412b - 4d 
Defining a domain D by 


D= {xe R? | -v3 < zı < v3) 


it can be easily seen that V(x) > 0 and V(x) < 0 in D — (0). Inspecti 
be easi — {0}. cting th 
portrait in Figure 8.3 shows that D is not a subset of ae i j iae" 


In view of this example, it is not difficult to see why D of Theorem 4.1 or 
Corollary 4.1 is not an estimate of R4. Even though a trajectory starting in D 
will move from one Lyapunov surface V(x) = c; to an inner Lyapunov surface 
Ví(z) = c2, with c2 < ci, there is no guarantee that the trajectory will remain 
forever in D. Once the trajectory leaves D, there is no guarantee that V(z) will 
be negative. Consequently, the whole argument about V (a) decreasing to zero falls 
apart, This problem does not arise when R4 is estimated by a compact positively. 
buio es of. 2 that, An a compact set Q C "Dinieh a oy tri jechory "s 

ting in © stays in Q for all. future time. i 
of Ra. The oes : ipis gan A mee 4.4 shows that Q is a subset 
cre Ry |V (e). c} 


é 
11 i , 

Es Set (ve € c) may have more than one component, but there can be only one bounded 

ponent in D, and that is the component we work with. For example, if V(z) = z?/(1 + 


v4) and D = {|x| < 1), the set (V(z) < 1/4) has two components: {iel € v2- vat and 


(ia 2 va và). We work with (ia < v2-¥3}. 


Men 
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; TE Y bounded and contained in D. For a quadratic Lyapunov function V(z) = 
c Pr = {Ilzll2 < r}, we can ensure that Re C D by choosing 


"E. 
c< min z Px = Amin(P)r? 


For D = {|b z| < r}, where b € ^, 


gms 
ATP-U 


T . 
Therefore, (zT Pz < c} will be a subset of D = (Ibfz] < ri, i 2 1,... p} if we 


choose 

2 

: ri 

< min =! 
Isigp b] P-1b, 


The simplicity of estimating the region of attraction by Re = (zTPz < c) has | 


increased significance in view. of the linearization results of Secti 
cance in. view. of | ection 4.3. 
saw that if the Jacobian matrix ` ee ete 


A= Ox z=0 


is Hurwitz, then we can always find a quadratic Lyapunov function V(z) = zT Pr 
by solving the Lyapunov equation PA+ AT P = —Q for any positive definite matrix 
Q. Putting the pieces together, we see that whenever A is Hurwitz, we can estimate 


the region of attraction of the origin. This is illustrated by the next example. 4b Les 


Example 8.9 The second-order system (ox) 


i = -r 
i2 = m+ (a? ~ 1)z2 
was treated in Example 8.5. There, we saw that the origin is asymptotically stable 
since 
A= 9f = 0 o 
OF |... 1 ~l 


is Hurwitz. A Lyapunov function for the system can be found by taking Q = I and 
solving the Lyapunov equation 


PA+ATP=-] 


pa MEET 
12Following [122, Section 10. 3], the La j i i 

k .í grangian associated with the constrained optimization 

problem is £(z, X) = zT Px + A[(bTz)? — r2]. The first-order necessary conditions are 2Pz + 


2A(bT1)b = Q and (bTx)? — r? = 0. It can be verified that the solutions A = —1/(bT P-!5) and 


x = trP—16/(b7 P—15) yield the minimal value r2/(bT P715). 


A 
2a 
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for P. The unique solution is the positive definite matrix 


15 -05 l 


Een 1 


The quadratic function V(x) = x7 Px is a Lyapunov function for the system in 
a certain neighborhood of the origin. Because our interest here is in estimating 
the region of attraction, we need to detennine a domain D about the origin where 
V (z) is negative definite and a constant c > 0 such that Q, = {V(z) € c) isa 
subset of D. We are interested in the largest set €. that we can determine, that 
is, the largest value for the constant c. Notice that we do not have to worry about 
checking positive definiteness of V(x) iu D because V(z) is positive definite for all 
z. Moreover, V(x) is radially unbounded: hence Ne is bounded for any c > 0. The 
derivative of V(x) along the trajectories of the system is given by 


V(z) = - (zi + 23) — (ize ~ 27122) 
The right-hand side of V(z) is written as the sum of two terms. The first term, 


—||z|[2, is the contribution of the linear part Az, while the second term is the 
contribution of the nonlinear term g(x) — f(x) — Az. Since 


io) an 
[lh 


we know that there is an open ball D = {x € R? | lizl| < r} such that V(z) is 
negative definite in D. Once we find such a ball, we can find Ne C D by choosing 


c< Ain V(x) = Amin(P)r? 


2llo=r 


—0 as |æ — 0 


Thus, to enlarge the estimate of the region of attraction, we need to find the largest 


ball on which V (x) is negative definite. We have 


, v5 
Viz) < -lelg + [zal lzizol lei — 222| < -lizllĝ + -z lieli 


where we used |z1} < ||zllz |t122} < |[zi|2/2, and |x, — 2z2| € V5llzll2. Thus, V(x) 
is negative definite on a ball D of radius given by r? = 2/75 = 0.8944. In this 
second-order example, a less conservative estimate of Ne can be found by searching 
for the ball D in polar coordinates. Taking 


zı = pcos@, z2 = psin# 


we get 
V = —p* +p cos? 8sin6(2sin — cos) 
< =ø? + p*|cos? 8sin6| - |2sin 9 — cos 6| 
< -p? +p! x 0.3849 x 2.2361 
1 
< -g +0. 4 jieren a 
< —p*+0.861p" <0, for p^« 0:861 
mS . ax 


a - " : a : 
^*^ 4 
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Figure 8.4: (a) Contours of V (z) = 0 (dashed), V(x) = 0.8 (dash-dot), and V(z) = 
2.25 (solid) for Example 8.9; (b) comparison of the region of attraction with its estimate. 


Using this last equation, together with Amin(P) > 0.69, we choose 


0.69 
c=08< 0.861 = 0.801 
The set Ne with c = 0.8 is an estimate of the region of attraction. A less conservative 
(that is, larger) estimate can be obtained by plotting contours of V(r) = 0 and 
V(z) = c for increasing values of c until we determine the largest c for which 
V(z) = c will bein (V(z) < 0}. This is shown in Figure 8.4(a) where c is determined 
to be c = 2.25. Figure 8.4(b) compares this estimate with the region of attraction 


whose boundary is a limit cycle. A 


Estimating the region of attraction by Ne = (V(z) € c) is simple, but usually” 


conservative: According pcb ears theorem, (Theorem 4.4); we can work with 
any. compact set N.C D. provided we. ca ts in 
typically. requires investigating the vector: field at:the boundary of N to ensure that 


trajectories starting in- (2 cannot leave. it: The üext example illustrates this idea. 
Example 8.10 Consider the system. 
ij = 2 | 
fo = ~—4(z, +22) — A(z) +22) 
where h: R — R is a locally Lipschitz function that satisfies 
h(0) =0; uh(u) > 0, ¥ [ul € 1 


Consider the quadratic function 


vios [1 pente 


we can show that: is positively invariant. t. 


Figure 8.5: Estimates of the region of attraction for Example 8.10. 


as a Lyapunov function candidate.!? The derivative Y (z) is given by 


V(z).— (dary + 222)i + 2(21 + 22); 
. -2zj — 6(zi  z)? — 2(1 + z2)h(zi + z2) 
S -2zj - (x, +29)", LV. [ri +00] 15 


"15 s] 
Therefore, V (z) is negative definite in the set 
G= {re R? | |r) +29{ <1} 


spen = iis hie ba rign is asymptotically stable. To estimate-R Ay let 
. by.an estimate ofthe form 0, —1V 2) hi 
COEM ¢ = {V (x) € e)? The largest c > 0 for which 


: H 
c= mi T Py = = 
jatra Pz bTP-1b -1 


T m ? 
where b^ = [1 1]. Hence, Q. with c = 1 is an estimate of Ra. (See Figure 8.5.) 


In this. example, we can obtain a better estimate of Ry:by not restricting ourselves 


E Sire of the form Ne. A key point in the development is to observe that 
rajectories inside G cannot leave through certain segments of the boundary |r; + 


z2| = 1. This can be seen by examining the vector field-at the boundary or by the © ° 


following analysis: Let 


o= +722 


— m 
13This Lya i i 
punov function candidate can be derived by usi j 
a a $ i 
by applying the circle criterion and the a dui degno 


a 
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‘such that the boundary of G is given by ø = 1 and o = —1. The derivative of o? 
~ + along the trajectories of the system is given by 


d BoP okey 
X^ = 20 (t1 + i2) = 2022 — 8c? — 20h(o) < 202; ~ 80°, V Jol <1 


On the boundary c = 1, 


t 


Zo? 2n - d «0, Vz2; 44 

This implies that when the trajectory is at any point on the segment of the boundary 
a = 1 for which z2 < 4, it cannot move outside the set G, because at such point c? 
is nonincreasing. Similarly, on the boundary c = —1, 

a € —2z2 -8 € 0, V 25 2 

dt S 7422-88 YU, T2 >? —4 

Hence, the trajectory cannot leave the set G through the segment of the boundary 
g = —1 for which z; > —4. This information can be used to form a closed, bounded, 
. positively invariant set Q that satisfies the conditions of Theorem 4.4. Using the 
two segments of the boundary of G just identified to define the boundary of 2, we 
now need two other segments to close the set. These segments should have the 
property that trajectories cannot. leave the set through them. We can take them 
as segments of a Lyapunov surface. Let cı be such that the Lyapunov surface 
V(z) = c, intersects the boundary zi + 29 = 1 at z2 = 4, that is, at the point 
(—3,4). (See Figure 8.5.) Let cz be such that the Lyapunov surface V(x) = ca 
intersects the boundary z1 +22 = —1 at z2 = —4, that is, at the point (3, —4). The 
required Lyapunov surface is defined by V(x) = min(c1,c2). The constants c; and 
c2 are given by 


cm V(z)h anm 710, c2 = Va) oasa = 10 
Therefore, we take c = 10 and define the set Q by 
Q = {z € R? | V(z) < 10 and |x; + z2| € 1) 


This set is closed, bounded, and positively invariant. Moreover, V (z) is negative 
definite in 2, since N C G. Thus, all the conditions of Theorem 4.4 are satisfied and 
we can conclude that all trajectories starting in 2 approach the origin as t — 00; 
that is, (1 C Ra. A 


8.3. Invariance-like Theorems LEMA Qc BARBALAT 


In the case of autonomous systems, LaSalle’s invariance theorem (Theorem 4.4) 
shows that the trajectory of the system approaches the largest invariant set in E, 


` its own sake and is known as Barbalat’s lemma. 
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where E is the set of all points in 2 where V(x) 5 0. In the case of nonautonomous 
systems, it may not even be clear how to define a set E, since V (t, x) is a function 
of both t and z. The situation will be simpler if it can be shown that 


V(t,z) € -W(z) <0 


for, then, a set E may be defined as the set of points where W(x) = 0. We may 
expect that the trajectory of the system approaches E as t tends to oo. This is, 
basically, the statement of the next theorein. Before we state the theorem, we state 
a lemma that will be used in the proof of the theorem. The lemma is interesting in 


Lemma 8.2 Let ó: R — R be a uniformly continuous function on [0, oo). Suppose 
that limi. I^ d(T) dr exists and is finite. Then, 


o(t) — 0 as 1 co 


o 


Proof If it is not true, then there is a positive constant kı such that, for every 
T > 0. we can find Tj > T with |ó(21)| > kı. Since ó(t) is uniformly continuous, 
there is á positive constant kg such that |ó(t +7) — é(t)| < k1/2 for all t 2 0 and 


all 0 € T € ks. Hence, 


let 


ANNS ^N 


BUS 


llt) — oT) +AT) 
19(11)] — lolt) - (Ti) 


Viv 


Therefore, j 


Tika Ty +k ` 
I é(t) dt] = f lé(£) dt > 1k 
T T 


where the equality holds, since (t) retains the same sign for T, € t S Tj + ks. 
Thus, h $(r) dr cannot converge to a finite limit as £ > oo, a contradiction. © 


COLL CARR A. 


Theorem 8.4 Let D C R" be a domain containing x = 0 and suppose f (tx) is 
and locally Lipschitz in x, uniformly in t, on [0,00) x D. 
) [0, oo) x 


piecewise continuous in t 
Furthermore, suppose f(t,0) is uniformly bounded for all t 2 0. Let V : 


D — R be a continuously differentiable function such that 


Wi (z) < V(t,2) S Wa(z) < 


€ Cc 


V(t,z) = ^ 4 def) « -W(z) 


" 


| 
f 


r 


Js 
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? Vt20,Vz € D, where W(x) and W(x) are continuous positive definite functions 
DX and W(x) is a continuous positive semidefinite function on D. Choose r > 0 such 
> that B, C D and let p < minyzy=r Wi(z). Then, all solutions of $ = f(t,z) with 
» z(to) € (z € B. | Wz(z) < p] are bounded and satisfy 
>) W(z(0) —^0 as t- co 
2 Moreover, if all the assumptions hold globally and W, (z) is radially unbounded, the 
BP statement is true for all z(tg) € R^. o 
J Proof: Similar to the proof of Theorem 4.8, it can be shown that 
) l 2 
» (to) € {x € B, | W2(z) < p => z(t) € fo C {x € B, | Wi(z) < eh Vi> to 
p since V(t, x) < 0. Hence, [z(£)]| < r for all t 2 to. Because V (t, z(t)) is mono- 
e tonically nonincreasing and bounded from below by zero, it converges as t — oo. 
Y Now, 
A ; i 
2 W(z(r) dr < - n V(r,2(r)) dr = V(to.z(to)) - V(6z(0) 
J to to 
E Therefore, limi; de W (z(7)) dr exists and is finite. Since z(t) is bounded, i(t)- 
5 f(t, z(£)) is bounded, uniformly in t, for all £ > to. Hence, z(t) is uniformly contin- 
n uous in ¢ on (o, oo). Consequently, W (z(t)) is uniformly continuous in t'on [¢q, c0) 
Jj because W(z) is uniformly continuous in x on the compact set -B,. Therefore, by 
jy Lemma 8.2, we conclude that W(z(1)) — 0 as t — oo. If all the assumptions hold 
a globally and W;(z) is radially unbounded, then for any z(to), we can choose p so 
c large that x(t) € {z € R” | Walz) < p). o 
B 
E. The limit W (z(t)) — 0 implies that x(t) approaches E as t — oo, where 
2 NS 
» E-(z&eD|W(z) —0) 
i 
RE Therefore, the positive limit set of z(t) is a subset of E. The mere knowledge that 


z(t) approaches E is much weaker than the invariance principle for autonomous 
systems, which states that x(t) approaches the largest invariant set in E. The 
stronger conclusion in the case of autonomous systems is a consequence of the 
property of autonomous systems stated in Lemma 4.1, namely the positive limit 
set is an invariant set. There are some special classes of nonautonomous systems 
where positive limit sets have some sort of an invariance property. 14 However, for a 
general nonautonomous system, the positive limit sets are not invariant. The fact 
that, in the case of autonomous systems, z(t) approaches the largest invariant set 


A 


EUN CEU E 

Hisxamples are periodic systems, almost-periodic systems, and asymptotically autonomous sys- 
tems, Sec (154, Chapter 8] for invariance theorems for these classes of systems. See, also, [136] for 
a different generalization of the invariance principle. 
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in E allowed us to arrive at Corollary 4.1, where asymptotic stability of the origin 
is established by showing that the set E does not contain an entire trajectory of 
the systein, other than the trivial solution. For a general nonautonomous system 
there is no extension of Corollary 4.1 that would show uniform asymptotic stability. 
However, the next theorem shows that it is possible to conclude uniform asymptotic 
pee if, in addition to V (t, z) € 0, we can show that V decreases over the interval 
, bi i 


Theorem 8.5 Let D C R” be a domain containi ; 
i i i d ang x = 0 and suppose f (t, x) is. 
piecewise continuous in t and locally Lipschitz in x for all t 2:0 and z s js í 


x = 0 be an equilibrium point for $ = f(t,z) att = 0. Let VK 
=0, Let V:[0 
continuously. differentiable function such that SUE XP 


Wilt) < V(t,2) < Wa(z) ; 


av. | 
Vise m eT rüz)eo 


V(t + 6, $(£--ó:t,2)) - V(t,z) € -AV (t,£), 0« A «116 


ye EN Yr € D, for some ô > 0, where Wı(x) and W(x) are continuous positive 
| e functions on D and $(rit,a) is the solution of the system that starts at 
4X). Then, the origin is uniformly asymptotically stable. If all the assumptions 


hold globally and W, (z) is radially unbounded igin i. j 
bier Papi s y nded, then the origin is globally untformly 


Wi(z) 2 kel", Walz) < kalel; ky > 0, k2»0,0»0 | 
then the origin is exponentially stable. | o 


Proof: Choose r > 0 such that B, € D. Simi i 
nd ee r . Similar to the proof of Theorem 4.8, it 


z(to) € {x € B. | Wi(z) < p) = a(t) EM, YE to 
where p « Minyzy=r Wi(z), because V(t, x) € 0. Now, for all t > to, we have 


V(t+ 6,2(t + 8)) S V(&z(t)) - AV(t2(t)) = (1— XV (t, z(t) 


Moreover, since V (t, £) < 0, 


V(r,z(r) €V(tz(), Vvre[tta ô] 


15; i ition V 
It is shown in [1] that the condition V € 0 can be dropped and uniform asymptotic stability 


can be shown if 
V(t + 6, o(t + d;2,2)) - Vit, z) € —(llz 
for gome class K function y. PN 
There is no loss of generality in assuming that A < 1, for if the inequality is satisfied with 


Ai > 1, then it is satisfied for an iti 
à 21, y positive A < 1, since ~ - i i 
inequality could not be satisfied with A > 1, bor add S ey TP TOUT HU DNE 


For any t 2 to, let N be the smallest positive integer such that t < to + Nó. Divide 
ata the interval [to, to + (N —1)5] into (N — 1) equal subintervals of length 6 each. Then, 


V(tz(t)) € V(to+ (N —1)52(to + (N — 1)8)) 
S (1-V(to-- (N — 2)5,2(to + (N — 2)8)) 


< (1-A)U-UV(to, z(to)) 
1 


= a-y- AJ&7to/5y (to, z(to)) 
=a i eV (to, z(t0)) 
where 1 1 
b= gin 0-3 
Taking 
alr, s) = us eo 


it can be easily seen that o(r,s) is a class KL function and V(t, x(t)) satisfies 
V(t, x(t) S o(V (to, z(to)),t — to), Y V(to, (to) € [0, o] 


From this point on, the rest of the proof is identical to that of Theorem 4.9. The 
proof of the statements on global uniform asymptotic stability and exponential 
stability are the same as the proofs of Theorems 4.9 and 4.10. o 


l 4 «o Example 8.11 Consider the linear time-varying system 
i = A(t)x 


where A(t) is continuous for all t > 0. Suppose there is a continuously differentiable, 
symmetric matrix P(t) that satisfies 


O<eql<Pt)<el, Vt>0 
as well as the matrix differential equation 
"EG ~P(t) = P(t)A(t) + AT (t)P(t) + CT (t)C(2) 
where C(t) is continuous in t. The derivative of the quadratic function 
V(t,z) = 27 P(t) 
along the trajectories of the system is 


V(t,z) = —27C7(t)C(t)x < 0 
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The solution of the linear system is given by $(T;t,z) = 9(r,t)z, where (7, ¢) is 
the state transition matrix. Therefore, 


t6 


V(r, 0(7;t,2)) dr 


V(t 4 6,0(t + 6; t, z)) — V(t.z) 


E. A ST (r, t)" (r)C(r)8(r,1) dr a 
t 


M 
4c 
AC 
AC 
€ 

C 


| 
f 


—zTW(t,t + ô)z 


where fH a € 
W(t,t+ 4) = "i $7 (r,t)CT(r)C(r)&(r, t) dr . Ç 
t it 
Suppose there is a positive constant k < cg such that c 
W(t,t+6)>kI, Vt20 | WX 
then k € 
V(t+ 6,46 + 66,2) - V(t2) < -klal < = ÈVE 2) we 
Thus, all the assumptions of Theorem 8.5 are satisfied globally with Ae 
T k (€ 
Wi(z) = eillzlla, 12 1,2, A= cg «1 C 
and we conclude that the origin is globally exponentially stable. Readers familiar & 
with linear system theory will recognize that the matrix W (t, t + 6) is the observ- te 
ability Gramian of the pair (A(t), C(t)) and that the inequality W(tt +ò) > kI % 

is implied by uniform observability of (A(t), C(t)). Comparing this example with \ : 
Example 4.21 shows that Theorem 8.5 allows us to replace the positive definite- E 
ness requirement on the matrix Q(t) of (4.28) by the weaker requirement Q(t) = d: 
CT (t)C(t), where the pair (A(t), C(£)) is uniformly observable. A í 
Theorems 8.4 and 8.5 and their application to linear systems, as in Example 8.11, a 
are extensively used in the analysis of adaptive control systems.!" As an example, ú 
we analyze the adaptive control system of Section 1.2.6. a 
Lg 
Example 8.12 In Section 1.2.6, we saw that the closed-loop equation of a model . 
reference adaptive control system, with plant jp = apy, + kpu and reference model ~ 
Um = OmYm + Kmr, is given by l hs 
€ = Ameo +t kpdir(t) $ kpdaleo + Ym (t)] w 
à: = -yeor(t) hs 
da = —yeoleo + Ym(t)] v 
V See, for example, [87] and [168]. - . le 

] 
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he output and ¢ and ¢2 the system £ = A(t)r. Once again, using V as a Lyapunov function candidate, we 
i j i = yp — Ym is the output error, 1 bui 
e y > 0 is the adaptation gain, eo = Yp — Ym obtain 
etal parameter errors. It was assumed that kp > 0 and, of course, the ance 
h < 0. Furthermore, we assume that r(t) is piecewise continuo ES ie Ns 
model must have am < 0. V = -= e = —17CTCr, where C= p li 0 0} 
and bounded. Using i > 


e l 2g 
v -i le Uu mi T | From Example 8.12, we see that the origin will be uniformly asymptotically stable if 
i the pair (A(t), C) is uniformly observable. Since uniform observability of (A(t),C) 
is equivalent to uniform observability of (A(t) — K(t)C, C) for any piecewise con- 
tinuous, bounded matrix K(t),19 we take 


K(t) = V A [ am —Yes(t) —vYyee(t) J7 


to simplify the pair to 


as a Lyapunov function candidate, we obtain 


/-7 — b2€o(e + Ym) = 32 e «0 
V= T Eo + eoldir + does + dam) — $1€oT 2€ol€o m kp 
n 
By applying Theorem 8.4, we conclude that for any c > 0 and for. all initial EE 
the set (V « c], all state variables are bounded for all t > to and limy-o0 eo(t) F 2 
This shows that the output of the plant yp tracks the desired output o bs 
says nothing about the convergence of the parameter errors ¢ and ¢2 to zero. 


D Kpte(t) kpyelt) 

t verge to zero. For example, if r and Ym are nonzero T ? — 
ec nd d ds ied coo system will have an equilibrium subspace [eo = A(t) - K(t)C = | 0 0 ^ des r a i Lug | 
constant signals, the close p Sy à ao 0 
0, ¢2 = (am/km)¢1}, which shows clearly that, in general ¢; and $2 


converge to zero. "Fo derive conditions.,under- which ¢, and ¢2 will converge to 
zero, we apply Theorem 8.5. This will yield conditions under which the bee 
(e x 0, d1 — 0, ¢2 = 0) is uniformly asymptotically stable. Since we have already 
shown that all state variables are bounded, we can represent the closed-loop system l 
as the linear time-varying system 


am — kgr(t) kpyp(t) $5 


By investigating observability of this pair for a given reference signal, we can de- 
termine whether the conditions of Theorem 8.5 are satisfied. For example, if r is 
a nonzero constant signal, it can be easily scen that the pair is not observable. 
This is not surprising, since we have already seen that in this case the origin is not 
uniformly asymptotically stable. On the other hand, if r(t) = a sinwt with positive 


a and w, we have rgs(t) = r(t) and ys(t) = aM sin(wt + 6), where M and 6 are 

i 0 0 z, where z=] ¢; determined by the transfer function of the reference model. It can be verified that 

= En 0 0 i i 2 the pair is uniformly observable; hence the origin (ej = 0, à; = 0, $2 = 0) is 
—füp 


uniformly asymptotically stable and the parameter errors di (t) and ¢2(t) converge 


Suppose the reference signal r(t) has a steady-state value rs,(t); that is, lim, .so[r(t)- to zero as t tends to infinity.2° ^ 


rs, (£)] = 0. Then, lime.ooltm(t) — ys (t)] = 0, where Yss(t) is the ane 
sponse of the reference model. These limits, together with lim, os €o(t) = 0, 5 
that the linear system can be represented by 


 $-|A()* B) 


8.4 Stability of Periodic Solutions 


In Chapter 4, we developed an extensive theory for the stability of equilibrium 
points. In this section, we consider the corresponding problem for periodic solutions. 


mx If u(t) is a periodic solution of the system 


Se FB Me, Be BOs SS 


Gm ` Kptss(t) kpYes(t) E 
A(t) = | ret) 0 0 , and Jim B() - 0 
—yss(t) 0 0 
If we can show that the origin of < = A(t)z is uniformly asymptotically stable, we 


can use the property lim; B(t) = 0 to show that the origin of ¢ = [A(t) + B(t))z 
is uniformly asymptotically stable. Therefore, we concentrate our attention on 


i= f(t,zx) (8.14) 


what can we say about other solutions that start arbitrarily close to u(t)? Will 
they remain in some neighborhood of u(t) for all t? Will they eventually approach 
i 


J9See [87, Lemma 4.8.1]. 

For this example, the reference r(t) = asinwt is said to be persistently exciting, while a 
constant reference is not persistently exciting. To read more about persistence of excitation, see 
{5}, [18], [87], [139], [168], or Section 13.4 of the second edition of this book. 


BS 


'8See Example 9.6. 
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l u(t)? Such stability properties of the periodic solution u(t) can be characterized 
and investigated in the sense of Lyapunov. Let 


y =z -— u(t) 


So that the origin y = 0 becomes an equilibrium point for the nonautonomous 
_ System 
y= f(t,y + u(t)) — f(tu(t)) (8.15) 


“~ ‘The behavior of solutions of (8.14) near u(t) is equivalent to the behavior of solu- 
tions of (8.15) near y — 0. Therefore, we can characterize stability properties of 
u(t) from those of the equilibrium. y = 0. In particular, we say that the periodic 
solution u(t) is uniformly asymptotically stable if y = 0 is a uniformly asymptot- 
ically stable equilibrium point for the system (8.15). Similar statements can be 
made for other stability properties, like uniform stability. Thus, investigating the 
stability of u(t) has been reduced to studying the stability of an equilibrium point of 
. &nonautonomous system, which we studied in Chapter 4. We shall find this notion 

‘ of uniform asymptotic stability of periodic solutions in the sense of Lyapunov to be 
useful when we study nonautonomous systems dependent on small parameters in 
Chapter 10. The notion, however, is too restrictive when we analyze periodic solu- 
tions of autonomous systems. The next example illustrates the restrictive nature of 
. this notion. 


t -Example 8.13 Consider the second-order system 


"Uu ‘ (1 — 2? - 22) 2. 232 
o h = n|] «0-2: -23)"| 
1 . 3 
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which is represented in the polar coordinates 


zı — rcosÓ, t2 =rsinf 


by 
: EM. ] 
; t= UT, àó-1«(-72? 


The solution starting at (ro, 9) is given by 


1/2 
1-7 


1+ 4t (1— 12)? 
Bo +t-+4In [1 + 4¢(1 — 75)?] 


r(t) 1- 


it 
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From these expressions, we see that the system has a periodic solution 
Z(t) = cost, Fo(t) =sint 


The corresponding periodic orbit is the unit circle r = 1. All nearby solutions 
spiral toward this periodic orbit as t — oc. This spiralling is clearly the kind of 
“asymptotically stable" behavior we expect to see with a periodic orbit. In fact, 
the periodic orbit has been known classically as a stable limit cycle. However, 
the periodic solution Z(t) is not uniformly asymptotically stable in the sense of 
Lyapunov. Recall that for the solution to be uniformly asymptotically stable, we 
must have 


[r(t) cos 8(£) ~ cos t]? + [r(t) sin@(t) — sint]? +0 as t— oc 


for sufficiently small [ro cos ĝo — 1]? + [ro sin 9o]?. Because r(t) — 1 as t > oo, we 
niust have 

|1 — cos(8(t) - t)) 50 as t— oo 
which clearly is not satisfied when ro Æ 1, since (8(t) — t) is an ever-growing mono- 
tonically increasing function of t. A 


The point illustrated by this example is true in general. In particular, a nontrivial 
periodic solution of an autonomous system can never be asymptotically stable in 
the sense of Lyapunov.?! 

The stability-like properties of tlie periodic orbit of Example 8.13 can be cap- 
tured by extending the notion of stability in tle sense of Lyapunov froin stability 
of an equilibrium point to stability of an invariant set. Consider the autonomous 
system 

z= f(r) (8.16) 


where f : D — R” is a continuously differentiable map from a domain D C R” into 
R^. Let M C D be a closed invariant set of (8.16). Define an e-neighborhood of M 
by 

U: = {x € R” | dist(x, M) < €} 


where dist(z, M) is the minimum distance from z to a point in M; that is, 
dist(r, M) = b lz- vil 
Definition 8.1 The closed invariant set M of (8.16) is 
è stable if, for each € > 0, there is 6 > 0 such that 


z(0) € Us > a(t) eU, Vtz 0 


21See [72, Theorem 81.1] for a proof of this statement. 
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e asymptotically stable if it is stable and ô can be chosen such that 


z(0)€ Us > jim dist(z(t), M) =0 


This definition reduces to Definition 4.1 when M is an equilibrium point. Lyapunov 
stability theory for equilibrium points, as presented in Chapter 4, can be extended 
to invariant sets.22 For example, by repeating the proof of Theorem 4.1, it is 
not hard to see that if there is a function V(z), which is zero on M and positive 
in some neighborhood D of M, excluding M itself, and if the derivative V(x) = 
[8V/8z]f(z) € 0 in D, then M is stable. Furthermore, if V (x) is negative in D, 


excluding M, then M is asymptotically stable. 
Stability and asymptotic stability of invariant sets are interesting concepts in 


their own sake. We will apply them here to the specific case when the invariant set 
M is the closed orbit associated with a periodic solution. Let u(t) be a nontrivial 
periodic solution of the autonomous system (8.16) with period T, and let 7 be the 


closed orbit defined by 
y= (ze P^ |z-w(t), 0st T) 
The periodic orbit ^ is the image of u(t) in the state space. It is an invariant 


set whose stability properties are characterized by Definition 8.1. It is common, 
especially for second-order systems, to refer to asymptotically stable periodic orbits 


as stable limit cycles 

Example 8.14 The harmonic oscillator 
ip = r 
$9 = ~t 


has a continuum of periodic orbits, which are concentric circles with a center at 
the origin. Any one of these periodic orbits is stable. Consider, for example, the 
\ . 


periodic orbit ^, defined by 


c= {2 € R |r=c>0}, where r = 1/2? +23 


The Ue neighborhood of ^. is,defined by the annular region 
Us = {r6 R |c~e<r<c+e} 


This annular region itself is an invariant set. Thus, given € > 0, we can take ô = € 
and see that any solution starting in the Us neighborhood at t = 0 will remain in 
the U, neighborhood for al) ? > 0; Hence, the periodic orbit Ye is stable. However, 
it is not asymptotically stable, because a solution starting in a Us neighborhood 


nira CUR t TENUSUE d 
22See, for example, [213] and [221] for comprehensive coverage and [118] for some interesting 
results on converse Lyapunov theorems. 
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of ^c does not approach 4, as t — oc 
Ye d ; Ho matter how small ô is. Stability 
periodic orbit {r = c} can be also shown by the Lyapunov function P 


V(z) = (à - & = (ad ad - 02)? 
whose derivative along the trajectories of the system is 


V(z) = 4(r? — r0 


, 


A 
Example 8.15 Consider the system of Example 8.13. It has an isolated periodic 


orbit 
y={reR |r- 1), wherer = VER. 
For x £ y, we have 


dist(z, 7) = inf lz ~ vlla = inf (zi =- 3)? + (z2 — yo)? = |r — 1| 


Recalling that 
1/2 
1-r$ 


V1 - 4t (1 — 12)? 
it can be easily seen that the c-ó requirement for stability is satisfied and 
dist(z(t), y) + 0, as t — oo 


Hence, the periodic orbit i ptoti 
is asymptotically stable, T i 
arrived at using the Lyapunov function ce orcas es 


V(z) = (r? - 1)? = (23 & a2 - 1? 


Whose derivative along the trajectories of the system is 


r(t) = | = 


V(x) = 4(r? - 1)r$ = -4(r? -1* «0, forr #1 


A 


Having defined the stabilit i 
da y properties of periodi i 
stability properties of periodic solutions. PR O EE A 


Definition 8.2 A nontrivial periodic solution u(t) of (8.16) is 
e orbitally stable if the closed orbit ^; generated by u(t) is stable 


e asymptotically orbitally stable i i 
ae y stable if the closed orbit ^y generated by u(t) is asymp- 


Noti f : ; 
ps Mino sides ae is used depending on whether we are talking about 
3 n or the corresponding periodic orbi am 
that the unit circle is an as i iiber re un Tae 
t th ymptotically stable periodic orbi : 
asyr it, b 
periodic solution (cos t, sin t) is orbitally asymptotically stable E 
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„5z, Exercises 
8.1 Prove Corollary 8.1. 
,,8.2 Prove Corollary 8.2. 


" . 8.8 Suppose the conditions of Theorem 8.1 are satisfied in a case where gi (9,0) = 
0, 9g2(y, 0) = 0, and A, = 0. Show that the origin of the full system is stable. 


.., 8.4 Reconsider Example 8.1 with a = 0. Show that the origin is stable. 
` 8.5 ({88]) Consider the system 


ig = falta, 25) 
d, Apzy + folTa, To) 


where dim(za) = nj, dim(z») = ne, Ay is Hurwitz, fa and fy are continuously 
differentiable, (8f,/8x,](0,0) = 0, and f,(za,0) = 0 in a neighborhood of za = 0. 


(a) Show that if za = 0 is an exponentially stable equilibrium point of ta = 
fa(Za,0), then (£a, T4) = (0,0) is an exponentially stable equilibrium point of 
the full system. 


(b) Show that if Ta = 0 is an asymptotically (but not exponentially) stable equilib- 
': rium point of Za = fa(Ta, 0), then (£a, 24) = (0,0) is an asymptotically stable 

Pp equilibrium point of the full system. 

8.6 ((70]) For each of the following systems, investigate stability of the origin by 

using the center manifold theorem: 


x . 2 


ij = -T i = az?—a2 
aj a ea d CO Malos Ir PS 
2 = T2 + T1 + 2122 T2 = T2 + TÍ + 2129 
i ti = —-—224 (73 dr cam y 
(3) 2; = zictzu (4) h = xc 
ts = -z — (xj +23) +33 dag 2c: 
eS 3 ; 3 
di = 2423 $i = —@+23(2,+22-1) 
5) Í 1+ z5(21 + 22 
(5) fg = 22-2? + 228 (6) ij; = 3(a1+22-1) 
& = 2 = —2x, -322+23+23 
(T) $3. = ~x2+ar$/(1+ 21) (8 i9 = 2, +a7+2 
a#0 ig = qf 
8.7 ([34]) Consider the system 
£1 T1224 az? + bziz2, fo = -T2 + cx? + dz?» 
it $ E 
Mam mM E aay ia pem NL mm emn 3 rc * ee 
um. 3 E caves Ed ia t etm mace cca ti ias... 
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l Investigate stability of the origin by using the center manifold theorem for each of 


the following cases: 


(1) a+c>0. (2) a+c<0. 
(3) a+c=0 and cd - bc? <0. (4) a+c=0 and cd 4 bc? > 0. 
(5) a-- c cd - bc? — 0. 


8.8 ([34]) Consider the system 
i = ar] t 1173, t2 = —r94 r? +2122 —- zj 


Investigate stability of the origin by using the center manifold theorem for all pos- 
sible values of the real parameter a. 


8.9 ([88]) Consider the system 
İı = ar,22— zj, fo = —2q + bro + cx} 


Investigate stability of the origin by using the center manifold theorem for all pos- 
sible values of the real constants a, b, and c. - 


8.10 (Zubov’s Theorem) Consider the system (8.13) and let G C R” be a do- 
main containing the origin. Suppose there exist two functions V : G — R and 
h: R” — R with the following properties: 


e V is continuously differentiable and positive definite in G and satisfies 


0«V(z) «1, VzeG (0) 


e As x approaches the boundary of G. or in case of unbounded G as |z|| — 00, 
lim V(x) = 1. 


e h is continuous and positive definite on R". 


e For z € G, V (x) satisfies the partial differential equation 
OV 
a? = -h(z)-V(z)l (8.17) 


Show that z — 0 is asymptotically stable and G is the region of attraction. 
8.11 ([72]) Consider the second-order system 
£j = —hi(zi) + ga(2), tg = —g(mn) 


where 
hy (0) = 0, zh, (z) >0 Y -a <z «b 


"wow www 
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gi(0) 20, z9(z2) 20 V -ai <2 «bi 
] sio o0 as z= cmn 
0 


for some positive constants ai, bi (a; = co or bi = oo is allowed). av Zubov's 
theorem to show that the region of attraction is {z eR | -a < Ti < i a 
Hint: Take h(x) = gi(zi)hi(zi) and seek a solution of the partial in um ia 
equation (8.17) in the form V (z) = 1— Wa (21) Wa (ra). Note that, with t : oice 
of h, V (z) is only negative semidefinite; apply LaSalle’s invariance principle. 


8.12 Find the region of attraction of the system 
@1=-2, + 12, t = —tan(zi) 


Hint: Use the previous exercise. 


8.13. Let Q be an open, positively invariant set containing the origin. Suppose 
every trajectory in Q approaches the origin as t — oo. Show that f? is connected. 


8.14 Consider a second-order system £ = f(z) with asymptotically stable origin. 
Let V(z) = z? + 23, and D = {z € R? | |zo| < 1, |zi — z2| < 1}. Suppose 
[ƏV/ðzx] f(x) is negative definite in D. Estimate the region of attraction. 


8.15 Consider the system 
t=T, ^ $= —2, — Tj — (2:9 + z1)(1 723) 
(a) Using V(x) = 52? + 22125 + 223, show that the origin is asymptotically stable. 


(b) Let 
S= {x € R? | V(x) <5} N {x € R? | |x| <1} 


Show that S is an estimate of the region of attraction. 
8.16 Show that the origin of 
l 1i - Z2; dg = —:9- zz] 
is asymptotically stable ond estimate the region of attraction. 


8.17 Consider a second-order system z = f(z), together with a Lyapunov function 
V(x). Suppose that V(x) < 0 for all z? + z2 > a?. The sketch, given in Figure 8.6, 
shows four different directions of the vector field at a point on the circle z2--z2 = a?. 
Which of these directions are possible and which are not? Justify your answer. 


8.18 Consider the system 


Åi = 29, dy = — T3 ~ sin T) — 2 sat(z, + 29) 


eee ques uii canquam: a a ee Heer ecc 3 
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Figure 8.6: Exercise 8.17. 


(a) Show that the origin is the unique equilibrium point. 
(b) Show, using linearization, that the origin is asymptotically stable. 
(c) Let o = 2, + z2. Show that o & € ~|ø| for [e| > 1. 
(d) Let V(z) = z? + 0.523 + 1 — cos zj. Show that 
| Mz = {2 € R?|V(2) <e}n{ze FR] [ol 1, c»0 
is ostiis sian and trajectories in M; approach the origin as t ~ oo. 


(e) Show that the origin is globally asymptotically stable. 


8.19 Consider the synchronous generator model described in Exercise 1.8. Take 
the state variables and parameters as in parts (a) and (b) of the exercise. Moreover, 
take T = 6.6 sec, M = 0.0147 (per unit power) x sec?/rad, and D/M = 4 sec7}, 


' (a) Find all equilibrium points in the region —7 < x, < m, and determine the 


stability properties of each equilibrium by using linearization. 
(b) Estimate the region of attraction of each asymptotically stable equilibrium. 
8.20 ([113]) Consider the system 
t=T} — $9: -z ~ g(t)rs 
where g(t) is continuously differentiable and 0 < ki < g(t) € ka for all t > 0. 
(a) Show that the origin is exponentially stable. | 


(b) Would (a) be true if g(t) were not bounded? Consider g(t) = 2 + exp(t). 


A A Hh a. 
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.21 Consider the system 
Ant F t=T} t= —sinz, — g(t)zo 
. Where g(t) is continuously differentiable and 0 < kı < g(t) < ke for all t > 0. Show 


that the origin is exponentially stable. 
Hint: Use the previous exercise. 


. 8.22 Consider the system 
tı = —-2,~-2%2—a(t)t3, f2=21,. t3 = o(t)n 
where a(t) = sin t + sin 2t. Show that the origin is exponentially stable. 
8.23 Consider the single-input-single-output nonlinear system 
d; = vai, 1<i<n-1 
fo(z) + (6°)? fa(z) + go(z)u 


`? where fo, fi, and go are known smooth functions of z, defined for all z € R”, 

` while 0* € RP is a vector of unknown constant parameters.. The function go(z) is 
bounded away from zero; that is, |go(z)| 2 ko > 0, for all z € R”. We assume that 

- all state variables can be measured. It is desired to design a state feedback adaptive 
controller such that zı asymptotically tracks a desired reference signal r(t), where 
r and its derivatives up to r(?) are continuous and bounded for all t > 0. 


p 
Tn 


.. (a) Taking e; = z;— 757! and e = [e1, ..., e€n]7, show that e satisfies the equation 
XP EE -è= Ae + Blfo(z) + (6°) fila) + go(z)u — r™) 
where (A, B) is a controllable pair. 


gu i n 

< (b) Design K such that A — BK is Hurwitz and let P be the positive definite 

l solution of the Lyapunov equation P(A ~ BK) + (A — BK ) P = -I. Using 
the Lyapunov function candidate V = eT Pe+ 9T 710, where  — 0 —0* and 
T is a symmetric positive definite matrix, show that the adaptive controller 


1 T (n) 
—i- -0 — Ke 
s) [ hla) fi(z) +r | 
6 = Tfi(x)e™PB 
^ ensures that all state variables are bounded and lim¿—oo e(t) = 0. 


| (c) Let 


u = 


A(t) = | Onxn -BffT(R) | , C= [ In Onxp ] 


Opxn Opxp 
where R = [r, ..., r(^-D]T. Show that if (A(t), C) is uniformly observable, 
then the parameter error ¢ converges to zero as t — oo. 


Chapter 9 : RORVTIELCACLON, (6 


Stability of Perturbed Systems 


Consider the system SET. 

t= f(t,z) + g(t.z) (9.1) 
where f : [0,oc) x D — R” and g : [0,oc) x D + R" are piecewise continuous in 
t and locally Lipschitz in z on [0,00) x D, and D C R" is a domain that contains 
the origin z = 0. We think of this system as a perturbation of the nominal system 


t-f(Lzr) (9.2) 


f The perturbation term ġ(t; z) could result from inodeling errors, aging, or uncertain- 
` ties and disturbances, which exist in any realistic problem. In a typical situation, 


we do not know g(f, zr). but we know some information about it, like knowing an 
upper bound on ||g(t. z)|. Here, we represent the perturbation as an additive term 
on the right-hand side of the state equation. Uncertainties that do not change the 
system's order can always be represented in this form. For if the perturbed right- 
hand side is some function f(t,z), then by adding and subtracting f(t,x), we can 
rewrite the right-hand side as 


f(t,z) = f(t,z) + [F(t.2) 2 f (t 2)] 


and define A 
g(t, z) = f(t x) x f(t, z) 


Suppose the nominal system (9.2) has a‘uniformly asymptotically stable equilibrium 
point at the origin, what can we say about the stability behavior of the perturbed 
system (9.1)? A natural approach to address this question is to use a Lyapunov 
function for the nominal system as a Lyapunov function candidate for the perturbed 
system. This is what we have done in the analysis of the linearization approach in 
Sections 4.3 and 4.6. The new element here is that the perturbation term could be 
more general than the perturbation term in the case of linearization. The conclu- 
sions we can arrive at depend critically on whether the perturbation term vanishes 
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_at the origin. If g(t,0) = 0, the perturbed system (9.2) has an equilibrium point 
at the origin. In this case, we analyze the stability behavior of the origin as an 
equilibrium point of the perturbed system. If g(t,0) # 0, the origin will not be 
an equilibrium point of the perturbed system. In this case, we study ultimate 
boundedness of the solutions of the perturbed system. 

The cases of vanishing and nonvanishing perturbations are treated in Sections 9.1 
and 9.2, respectively. In Section 9.3, we restrict our attention to the case when the 
nominal system has an exponentially stable equilibrium point at the origin and use 
the comparison lemma to derive some sharper results on the asymptotic behavior of 
the solution of the perturbed system. In Section 9.4, we give a result that establishes 
continuity of the solution of the state equation on the infinite-time interval. 

The last two sections deal with interconnected systems and slowly varying sys- 
tems, respectively. In both cases, stability analysis is simpli&ed by viewing the 
system as a perturbation of a simpler system. In the case of interconnected sys- 
tems, the analysis is simplified by decomposing the system into smaller isolated 
subsystems, while in the case of slowly varying systems, a nonautonomous system 
with slowly varying inputs is approximated by an autonomous system where the 
slowly varying inputs are treated as constant parameters. 


C ada) 


97 ? Vanishing Perturbation (desscilosinihr al de cos cuan de est 


Let us start with the case g(t,0) = 0: Suppose z = 0 is an exponentially stable equi- 
librium point of the nominal system (9.2), and let V(t, z) be a, Lyapunov function 
that satisfies 


EY T tas ole oshblidd ^ 25 


(El sedea PS aA os 


for all (t,£) € [0,oo) x D for some positive constants cj, c2, cs, and cq. The 
existence of a Lyapunov function satisfying (9.3) through (9.5) is guaranteed by 
Theorem 4.14, under some additional assumptions. Suppose the perturbation term 
(t, zx) satisfies the linear growth bound ` 


calle? < V(&.2) < ell (9.3) 


'— dez) Salz. Vt20 VeeD (9.6) 


where y is a nonnegative constant. This bound is natural in view of the assumptions ` 


on g(£,z). In fact, any function g(t,z) that vanishes at the origin and is locally 
Lipschitz in z, uniformly in t for all t > 0, in a bounded neighborhood of the origin 
satisfies (9.6) over that neighborhood.! We use V as a Lyapunov function candidate 


1Note, however, that the linear growth bound (9.6) becomes restrictive when required to hold 
globally, because that would require g to be globally Lipschitz in z. 
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to investigate the stability of the origin as an equilibrium point for the perturbed 
system (9.1). The derivative of V along the trajectories of (9.1) is given by 


; OV ƏV oV 
V(t, z) = t + ERUES t galha) 


The first two terms on the right-hand side constitute the derivative of V(t, x) along 
the trajectories of the nominal system, which is negative definite and satisfies (9.4) 
The third term, [8V/Az]g, is the effect of the perturbation. Since we do not have 
complete knowledge of g, we cannot judge whether this term helps or hurts the 
cause of making V(t,z) negative definite. With the growth bound (9.6) as our 
only information on g, the best we can do is worst case analysis where [8V/8x]g is 
bounded by a nonnegative term. Using (9.4) through (9.6), we obtain 


ne av ee en 
V(t,z) € —esliz]? + al llg(& z)]] Sesle? + cav]lz] 


If y is small enough to satisfy the bound 


y< S (9.7) 
then w 
< V(&2) < - (es — vez", (es — 564) > 0 
Therefore, by Theorem 4.10, we conclude the next lemma. 


.Lemma 9.1 Let x — 0 be an exponentially stable equilibrium point of the nominal 


system (9.2). Let V(t, x£) be a Lyapunov function of thé nominal system that satisfies . 


(9.3) through (9.5) in [0, oo) x D.: Suppose the perturbation term ‘g(t, x) satisfies 
(96) «and (9.7). Then, the origin is an. exponentially: stable’ equilibrium: point of - 
-the perturbed system (9.1). Moreover, if all the assumptions hold globally, then the 

origin is globally exponentially stable, ` : VV 9 


This lemma is conceptually important because it shows that exponential stabilit 
of the origin is robust with respect to a class of perturbations that satisfy (9,6) RE 
(9.7). To assert this robustness property, we do not have to know V(t,z) explicit] 
It is just enough to know that the origin is an exponentially stable equilibrium 
of the nominal system. Sometimes, we may be able to show that the origin is 
exponentially stable without actually finding a Lyapunov fünction that satisfies 
(9.3) through (9.5).? Irrespective of the method we use to show exponential stabilit 
of the origin, we can assert the existence of V (t, x) satisfying (9.3) through (9.5) by 


application of Theorem 4.14 (provided the Jacobi i i 
Misco db E dua t» e Jacobian matrix [8f /8z] is bounded) 


e Lyapunov function V(t, x) we cannot calculate the 


?This is the case, for example, 


rem 8.5. when exponential stability of the origin is shown using Theo- 


UH 
d 
5 


342 : CHAPTER 9. STABILITY OF PERTURBED SYSTEMS 


bound of (9.7). Consequently, our robustness conclusion becomes a qualitative one 
where we say that the origin is exponentially stable for all perturbations satisfying 


llg(t. x) < vill 


with sufficiently small y. On the other hand, if we know V(t, z), we can calculate 
the bound of (9.7), which is an additional piece of information. We should be 
careful not to overemphasize the usefulness of such bounds because they could be 
conservative for a given perturbation g(t, x). The conservatism is a consequence of 
the worst case analysis we have adopted from the beginning. 


Example 9.1 Consider the system 
l z= Ax + g(t, x) 


where A is Hurwitz and ||g(t,z)|l2 < y||z|l2 for all ¢ > 0 and all x € R”. Let 
Q 2 Q7 » 0 and solve the Lyapunov equation 


PA ATP « -Q 


for P. From Theorem 4.6, we know that there is a unique solution P = PT > 0. 
The quadratic Lyapunov function V(r) = x7 Pz satisfies (9.3) through (9.5). In 
particular, 


0V 
s^ = -zT Qr < —Amin(Q)ll 13 
z . 
aV T : 
os 1 = |[22* Plla < 2|Pllzllzlla = 22x CP)lzll2 


The derivative of V(z) along the trajectories of the perturbed system satisfies 
V (z) < -Amn (Q)|lzl T WAmax(P)yllall 


Hence, the origin is globally exponentially stable if y < Amin(Q)/2Amax(P). Since 
this bound depends on the choice of Q, one may wonder how to choose Q to maxi- 
mize the ratio Amin(Q)/Amax(P). It turns out that this ratio is maximized with the> 
choice Q = I (Exercise 9.1). A 


Example 9.2 Consider the second-order system 


ii = i2 
fg = -4xz- 223 + pr? 


where the constant @ > 0 is unknown. We view the system as a perturbed system 
of the form (9.1) with 


tome [1 AEn] m Ln] 
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The eigenvalues of A are —1 + jV3. Hence, A is Hurwitz. The solution of the 


Lyapunov equation P 
PA+A'’P=-I 


1 
1 a 
8 16 


As we saw in Example 9.1, the Lyapunov function V (z) = zT Pz satisfies inequalities 
(9.3) through (9.5) with c3 = 1 and 


is given by 


et 


P= 


€4 = Wmax(P) = 2 x 1.513 = 3.026 
The perturbation term g(x) satisfies 
llg(z)lla = lz? < 6k3leo| < Bkillzllo 


for all [z2| < ka. At this point in the analysis, we do not know a bound on z(t), 

although we know that z9(t) will be bounded whenever the trajectory x(t) is con- 

fined to a compact set. We keep k? undetermined and proceed with the analysis. 

Using V (x) as a Lyapunov function candidate for the perturbed system, we obtain 
V(z) < -lizlia + 3.0268%3||a|3 


Hence, V (z) will be negative dofinite if 


! 1 
| win, AS 3.026k2 

To estimate the bound ka. let f); = {x € R? | V(x) € c). For any positive constant 

c, the set 9, is closed and bounded. The boundary of 2, is the Lyapunov surface 


~ 


V(x) = 327 + irira + ad =e 
The largest value of 2| on the surface V(x) = c can be determined by differentiating 
the surface equation partially with respect to z;. This results in 


32, + irn =0 


Therefore, the extreme values of r2 are obtained at the intersection of the line 
zı = —Z2/12 with the Lyapunov surface. Simple calculations show that the largest 
value of z2 on the Lyapunov surface is 96c/29. Thus, all points inside 2. satisfy 
the bound 


|zo| < ko, where k? = — 
Therefore, if 
29 0.1 


b< 3035x960 c 
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V(x) will be negative definite in Q. and we can conclude that the origin z = 0 
is exponentially stable with Qe as an estimate of the region of attraction. The 
inequality 2 < 0.1/c shows a tradeoff between the estimate of the region of attraction 
and the estimate of the upper bound on 8. The smaller the upper bound on £, the 
larger the estimate of the region of attraction. This tradeoff is not artificial; it does 
exist in this example. The change of variables 


zm afa 
0 = y 2 

3 
2 = y (airs + 200 — 62d) = — Ss 
T = 2 


transforms the state equation into 


2 M 

dr I 

dz2 > 2 

dr 21 + (zi 1)z2 


which was shown in Example 8.5 to have a bounded region of attraction surrounded 


by an unstable limit cycle. When transformed into the z-coordinates, the region - 


of attraction will expand with decreasing 2 and shrink with increasing 8. Finally, 
let us use this example to illustrate our remarks on the conservative nature of the 
bound of (9.7). Using this bound, we came up with the inequality. 8 < 1/3.026k2, 
which allows the perturbation term g(t, £) to be any second-order vector that sat- 
isfies ||g(t, z)|go < 8kZ|z|l. This class of perturbations is more general than the 
perturbation we have in this specific problem. We have a structured perturbation in 
the sense that the first component of g is always zero, while our analysis allowed 
for an unstructured perturbation where the vector g could change in all directions. 
Such disregard of the structure of the perturbation will, in general, lead to conser- 
vative bounds. Suppose we repeat the analysis, this time taking into consideration 
the structure of the perturbation. Instead of using the general bound of (9.7), we 
calculate the derivative of V (t, x) along the trajectories of the perturbed system to 
obtain : 


c 
-|izll + 227 Pg(z) 


V(r) = 
= -lieli + 2823 (421z: + $23) 
< -|zli2 + 2603 ($lel? + Silxll2) 
< ~hel? + Fenzl? — 


Hence, V(z) is negative definite for B < 4/3k2. Using, again, the fact that for all 
T € Qe, |£2|? € k? = 96c/29, we arrive at the bound 8 < 0.4/c, which is four times 
the bound we obtained by using (9.7). A 


LA cl. wuA, kat ve E ` 
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When the origin of the nominal system (9.2) is uniformly asymptotically stable, 
but not exponentially stable, the stability analysis of the perturbed system is more 
involved. Suppose the nominal system has a positive definite, decrescent Lyapunov 
function V (t, x) that satisfies 


0V əv 
y T a, 629 € -Wi(a) 


for all (t,£) € [0,00) x D, where W3(zx) is positive definite and continuous. The 


derivative of V along the trajectories of (9.1) is given by 


. 0V əv dV 
V(t,z) = t T 5 I2) T oe 95 z) 


< mo) ors 


Our task now is to show that 


V | dou 
locato < Ws(z) 


for all (t,x) € (0,00) x D, a task that cannot be done by putting a simple order 
of magnitude bound on ||o(t, x)|, as we have done in the exponential stability case. 
The growth bound on [[g(t, z)]| will depend on the nature of the Lyapunov function 
of the nominal system. One class of Lyapunov functions for which the analysis 
is almost as simple as in exponential stability is the case when V(t, x) is positive 


definite, decrescent, and satisfies 


eee 2 o anta scere) (9.8) 


Ox 


for all (t,£) € [0, 00) x D for some positive constants c3 and c4, where 9: R” +R 
is positive definite and continuous. A Lyapunov function satisfying (9.8) and (9.9) 
is usually called a quadratic-type Lyapunov function. It is clear that a Lyapunov 
function satisfying (9.3) through (9.5) is quadratic type, but a quadratic-type Lya- 
punov function may exist even when the origin is not exponentially stable. We 
will illustrate this point shortly by an example. If the nominal system (9.2) has a 
quadratic-type Lyapunov function V (t, x), then its derivative along the trajectories 
of (9.1) satisfies 


| < ejf) (9.9) 


V (& z) < ese? (£) + cad (a)llo(t, z)] 
Suppose now that the perturbation term satisfies the bound 


lg(&z)l < yoz) y< Ë 
x C4 


pu tien On 
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Then, . 
V(tz) € —(es ~ cay)? (a) 
which shows that V (tx) is negative definite. 


Example 9.3 Consider the scalar system 


i= ~z? + g(t, r) 


The nominal system : 
‘ ! i= D 

has a globally asymptotically stable equilibrium point at the origin. but, as we saw 
in Example 4.23, the origin is not exponentially stable. Thus, there is no Lyapunov 
function that satisfies (9.3) through (9.5). The Lyapunov function V(z) = z* 
satisfies (9.8) and (9.9), with ø(z) = |z|, c3 = 4, and cy = 4. Suppose the 
perturbation term g(t, x) satisfies the bound ]g(t, z)] < »|z]* for all z, with «1. 
Then, the derivative of V along the trajectories of the perturbed system satisfies 


V(t,z) € -4(1 - y)e?(z) 


Hence, the origin is a globally uniformly asymptotieally stable equilibrium point of 
the perturbed system. ^ 


In contrast to the case of exponential stability, it is important to uotice that a 
nominal system with uniformly asymptotically stable, but not exponentially stable, 
origin is not robust to smooth perturbations with arbitrarily small lincar growth 
bounds of the form of (9.6). This point is illustrated by the next example? 


Example 9.4 Consider the scalar system of the previous example with perturba- 
tion g = yx where y > 0; that is, 


t=- +42 


It can be easily seen, via linearization, that for any ^ > 0 the origin is unstable, no 
matter how small + is. A 


l——— Beg Jain & “gto. 
[9.2 Nonvanishing Perturbation | [Sessio de Led. 


Let us turn now to the more general case when we do not know that g(t,0) = 0. 
The origin z = 0 may not be an equilibrium point of the perturbed system (9.1). 
We can no longer study stability of the origin as an equilibrium point, nor should 
we expect the solution of the perturbed system to approach the origin as t — oc. 
The best we can hope for is that z(t) will be ultimately bounded by a small bound. 
if the perturbation term g(t, x) is small in some sense. We start with the case when 
the origin of the nominal system (9.2) is exponentially stable. 


3See, also, Exercise 9.7. 
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“Lemma 9.2 Let z — 0 be an exponentially stable equilibrium point of the nominal 


system (9.2). Let V(t, x) be a Lyapunov function of the nominal system that satisfies 
(9.3) through (9.5) in [0, oo) x D, where D: = {z € R" | lx] <r}. Suppose the 
perturbation term g(t, x) satisfies E 


hes JCO > 9.10) 
Hoea ea i) ( 
glt 2) <6 RECE] r 
for all t 20, all z € D, and some positive constant 0 < 1. Then, for ali ||z(£o)]| < 
Va fear, the solution x(t) of the perturbed system (9.1) satisfies 

lz ll € &expI- (6 — to)lllz(to)|; Y to St «to +T 


d 
"E z(t) <b, Vi2to-T 


for some finite T, where 
C2 _ (1 = Jeg bac [ez 8 
E = P a Ws 2c i C3 [5] 8 


Proof: We use V (f. z) as a Lyapunov function candidate for the perturbed system 
(9.1). The derivative of V(t, z) along the trajectories of (9.1) satisfies 


o 


. oV 
Wess) < elel | latini 
€ -eslzli?  exólizll 
= -(1-6)jeslzll? — Pesia? + csólzl, 0 «8 «1 
< -(-6)eslzl. Vell 2 5c4/0c3 ‘ 
Applying Theorem 4.18 and Exercise 4.51 completes the proof. o 


Note that the ultimate bound b in Lemma 9.2 is proportional ld bite 
bound on the perturbation 6. Once again, this result can be o as I d gira 
property of nominal systems having exponentially stable equili ps di E 
because it shows that arbitrarily small (uniformly bounded) perturbatio 
result in large steady-state deviations from the origin. 


Example 9.5 Consider the second-order system 
$i = r2 
dy = 4x — 2r + pr} + a(t) 


where f > 0 is unknown and d(t) is a uniformly bounded disturbance eee 
gt) < 5 for all t > 0. This is the saine system we studied in Example 9.2, excep 
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for the additional perturbation term d(t). Again, the system can be viewed as 
a perturbation of a nominal linear system that has a Lyapunov function V(r) = 
zT Pz, where 


wile 


1 
8 
P= 
. 1 5 
8 16 
We use V(x) as a Lyapunov function candidate for the perturbed system, but 
we treat the two perturbation terms Bz3 and d(t) differently, since the first term 
vanishes at the origin while the second one does not. Calculating the derivative of 
V(x) along the trajectories of the perturbed system, we obtain 


V(tz) = -izl + 2623 (3122 + 3522) + 2d(t) (fxr + 1522) 
vial 


IA 


— [loll + 32kżllzllż + ~~ lizllz 


where we have used the inequality l 
[2x + 52r9| < llla V4 +25 


and kz is an upper bound on |z2|. Suppose 8 € 4(1 — ¢)/3k3, where 0 < Ç < 1. 
Then, 


296 
Wt) < -clalt + lel < -(1- yell, v lele 2 a= er 


where 0 « 0 « 1. As we saw in Example 9.2, lza? is bounded on 2, by 96c/29. 
Thus, if 8 € 0.4(1 — ¢)/e and ô is so small that p 2 \max(P) < c, then B, C f); and 
all trajectories nts inside 2, remain for all future time in Qe. Furthermore, 
the conditions of Theorem 4.18 are satisfied in Qe. Therefore, the solutions of the 
perturbed system are uniformly ultimately bounded by 


E V296 |Amax(P) 
“866 V Amin(P) 


In the more general case when the origin x = 0 is a uniformly asymptotically 
stable equilibrium point of the nominal system (9.2), rather than exponentially 
stable, the analysis of the perturbed system proceeds in a similar manner. 


A 


Lemma 9.3° Let x = 0 be a uniformly asymptotically stable equilibrium point of the 
nominal system (9.2). Let V(t,x) be a Lyapunov function of the nominal system 
that satisfies the inequalities* 


a (|l2||) < V(t, 2) < ox(lzll) (9.11) 


4The existence of a Lyapunov function satisfying these inequalities (on a bounded domain) is 
guaranteed by Theorem 4.16 under some additional assumptions. 
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ae + a fa) € -os(llrll) (9.12) 


SEET (9:13) 


in [0,00) x D, where D = {x € R” | ||z|| < r} and a;(-), i = 1,2,3,4, are class K 
functions. Suppose the perturbation term g(t, x) satisfies the uniform bound i 


&as (a7 (e (7))) | 
a(r) 910 


for all t > 0, all z € D, and some positive constant 0 < 1. Then, for all \|x(to) < 
az'(ai(r)), the solution x(t) of the perturbed system (9.1) satisfies 


a nS e cam 


llg(t.z)]| < < 


lz(£)]l S &(llz(to)llt ~ to), Y to <t < to+T 


and i 
le € alô), Vt2 to T a 


for some class KL function B and some finite T, where p is a class K function of 
ô defined by 


vo alale) 


Proof: We use V(t, x) as a Lyapunov function candidate for the perturbed system 
(9.1). The derivative of V(t, x) along the trajectories of (9.1) satisfies 


© 


vea) < -olle «| 27] teo 
€ -as(llzll) + óo.(lzl) 
< -(- Sas(le]) - Gaal) + daa(r), 08 «1 
< -ü- (lel). v al > os? (25889) 
Applying Theorem 4.18 completes the proof. a 


This lemma is similar to the one we arrived at in the special case of exponen- 
tial stability. However, there is an important feature of our analysis in the case of 
exponential stability, which has no counterpart in the more general case of uniform 
asymptotic stability. In the case of exponential stability, 6 is required to satisfy 
(9.10). The right-hand side of (9.10) approaches oo as r — oo. Therefore, if the 
assumptions hold globally, we can conclude that for all uniformly bounded distur- 
bances, the solution of the perturbed system will be uniformly bounded. This is the b 
case because, for any ó, we can choose r large enough to satisfy (9.10). In the case l 


& 
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of uniform asymptotic stability, ô is required to satisfy (9.14). Inspection of (9.14) 
shows that, without further information about the class K functions, we cannot 
say anything about the limit of the right-hand side as r — oo. Thus, we cannot 
conclude that uniformly bounded perturbations of a nominal system with a uni- 
formly asymptotically stable equilibrium at the origin will have bounded solutions 
irrespective of the size of the perturbation. Of course the fact that we cannot show 
it, does not mean it is not true. It turns out, however, that such a statement is 
not true. It is possible to construct examples (Exercise 9.13) where the origin is 
globally uniformly asymptotically stable, but a bounded perturbation could drive 
the solution of the perturbed system to infinity. 


p.a Comparison Method | 


Consider the perturbed system (9.1). Let V(ft,z) be a Lyapunov function for the 
nominal system (9.2) and suppose the derivative of V along the trajectories of (9.1) 
satisfies the differential inequality 


V € h(t,V) 
By (the comparison) Lemma 3.4, 


V(tz(t)) < y(t) 


where y(t) is the solution of the differential equation 
ý= hy), y (to) = V(to, r(to)) 


This approach is particularly useful when the differential inequality is lincar, that is, 
when A(t, V) = a(t)V + b(t), for then we can write down a closed-form expression 
for the solution of the first-order linear differential equation of y. Arriving at a 
linear differential inequality is possible when the origin of the nominal system (9.2) 
is exponentially stable. 

Let V(t,z) be a Lyapunov function of the nominal system (9.2) that satisfies 
(9.3) through (9.5) for all (t,x) € [0,oc) x D, where D = (x € R" | |x|] < r} 
Suppose the perturbation term g(t, x) satisfies the bound 


lg c) Sa@)llall +ê), Vtz0, VzeD (9.15) 


where y : R — R is nonnegative and continuous for all t > 0, and 6: R — Ris 
nonnegative, continuous, and bounded for all t > 0. The derivative of V along the 
trajectories of (9.1) satisfies 


VEA po SF at Pole z) 
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9.3. COMPARISON METHOD 
Using (9.3), we can find an upper bound on V as 


vs- [8-0] vec 2 


To obtain a linear differential inequality, we take W(t) = 
fact W = V/2VV, when V #0. to E 


V(t, z(t)) and use the . 


) (9.17) 


NA 
When V = 0. it can be shown? that D*W(t) < c45(t)/2,/er- Hence, D* W(t) 


satisfies (9.17) for all values of V. By the comparison lemma, W(t) satisfies the 


sis SENE) dr (9.18) 


where the transition function ¢(t, to) is given by 


` inequality 


W(t) < é(tto)W(to) + 


t 
C3 " C4 d | 
(t, to) = exp |- 2v to) + Sa Jg y(r) dr 


Using (9.3) in (9.18), we obtain 


t 
i liz (0l < Je eet + e [ b(t, 7)6(7) dr (9.19) 


Suppose now that y(t) satisfies the condition 


t ~ 
f y(r) dr Selt- to) +7 (9.20) 
to 
for some nonnegative constants € and 7, where 
eem (9.21) 
CICA 


Defining the constants a and p by 
oy eee an) 21 (9.22) 
ý 2 E e=] 2c 
and using (9.20) and (9.21) in (9.19). we obtain 


leol < Polster + 5° [ome 02m 


5See Exercise 9.14. 
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For this bound to be valid, we must ensure that ||z(t)|| < r for all t > to. Noting 
that® 
, J2 lia) jemet 4. E Bali [1 = gata sup ô(t) 
C1 


t>to 
NI =pl|x(to)ll, ah sapol J 
0 


we see that the condition ||x(¢)|| < r will be satisfied if 


IIO] 


“IA 


IA 


T [41 
x(to)|| < -4/— (9.24) 

lee < 2/4 

and 2c1or 
sup ó(t) < ——— ; (9.25) 

tzto Cap: 


For easy reference, we summarize our findings in the next lemma. 


Lemma 9.4 Let x — 0 be an exponentially stable equilibrium point of the nominal 
system (9.2): Let V (t,x) be a Lyapunov function of the nominal system that satisfies 
(9.3) through (9.5) in [0,00) x D, where D = {xr € R^. ‘Elele < r}: ^ Suppose 
' the perturbation term g(t, 2) satisfies (9: 15), "where y(t) satisfies (9.20) and (9.21). 

Then, provided x(tg): satisfies (9.24) and SUP; i é(t). satisfies (9.25), the solution of 
the perturbed. system, (9.1) ‘satisfies (9. 23): Furthermore, ‘if all the assumptions hold 
globally, then (9.23) is satisfied for any z(to). and: any bounded ó(t). o 


Specializing the foregoing lemma to the case of vanishing perturbations: that is, 
when $(t) = 0, we obtain the following result: 


Corollary. 9.1. Let x = 0 be an exponentially stable: equilibrium point of the nominal - 
system. (9.2): Let:V (t, x) be a Lyapunov function ‘of the nominal system that satisfies ; 


(9.3) through (9.5) in [0,00) x D. Suppose the perturbation term g(t, £) satisfies 
g(t, e) s vel. 


where y(t) satisfies (9. 20) and (9. 21). Then,’ the. origin is; an exponentially stable 
equilibrium point’ of the perturbed system (9.1). Moreover,’ 1 all the. assumptions 
hold globali then. the origin is globally: exponentially. stable... o 


If a(t )= y= “constant, then Corollary 9.1 requires ^ to satisfy the bound 
y< 01C3/ c2€4, which has no advantage over the bound y < c3/cq required by 
Lemma 9.1, since (c1/c2) € 1. In fact, whenever (c1/c2) < 1, the current bound 
will be more conservative (that is, smaller) than.the bound required by Lemma 9.1. 
The advantage of Corollary 9.1 is scen in the case when the integral of y(t) satisfies 
conditions (9.20) and (9.21), even when sup,>,, Y(t) is not small enough to satisfy 
SUPt> Y(t) < ca/c4. Three such cases are given in the next lemma. 


5 We use the fact that the function ae~°! + b(1 — e7**), with positive a, b, and a, relaxes 
monotonically from its initia] value a | to its final value b. Hence, it is bounded by the maximum 
of the two numbers. 


ae ee . qu er 
5» 3 : EC ASÍ e nc sean etme e idee, conia aii m iie 


Pee ene oe, DE 


9.3. COMPARISON METHOD 353 
Lemma 9.5 
1. If 
oo 
f y(r) dr € k 
0 
then (9.20) is satisfied with € — 0 and y = k. P 
2. If 


y(t) 20 as t— oo 
then for any € > 0, there is 7 = n(c) > 0 such that (9.20) is satisfied. 
3. If there are constants A > 0, T > 0, and e > 0 such that 


t+ 
aj ^ dr Ee, Vi2T 


then (9.20) is satisfied with € = £) and y = e^ + vt © 


Proof: The first case is obvious. To prove the second case, note that, because 
lim;.o0 y(t) = 0, for any € > 0, there is Ty = T, (e) > 0 such that q(t) < e for all 
t > Ti. Let n= = Jo y(t) dt. If to > T1, then 


t t 
[o dr < f Ste melt uo 


to 


If t € Ti, then 


, t Ty 
[ oos aren 
to 0 
If to < Tı < t, then 


[ow dr = [ues [a dr 


n į 
< [ y(r)dr *e(t— T) € q- e(t — to) 


In the last case, if t < T, then 


t T 
[0 ar f (7) dr «n 


to 


For t 2 ty > T, let N be the integer for which (N~DA<t-t, € NA. Then, 
t i2N-2 ath (it A t 
I y(r)dr = > if q(T) ar+ [ q(T) dr 
t 


imo Yetta 1*(N -1)A 
i=N-2 

S 2 EA t 6A S a(t-t8)-a4 
i=0 


i 
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This inequality is used next with t = tp when t > to > T, and with t; = T when 
ta ST € t. Ift 2 to x T. then 


t . 
I Ur) dr < e(t- t9) +siA < &(t- to) +7 
to : 


while if to € T < t, then 


i Y(T) dr 


li 


[oo dr + [39 dr 


te T 


I^ 


T 
f Y(T) dr +ei(t-T)+E1A < e(t- to) +7 
0 
o 


In the first case of the foregoing lemma, condition (9.20) is satisfied with € = 0, 
while in the second case, it is satisfied with arbitrarily small e. Therefore, in both 
cases, condition (9.21) is always satisfied and the origin of the perturbed system 
(9.2) is exponentially stable. The third case of the lemma sets a bound ona moving 
average of y(t) as t becomes sufficiently large. The origin of the perturbed system 
(9.2) will be exponentially stable if this bound is sufficiently small. 


Example 9.6 Consider the linear system 

l & = [A(t) + B(t)]x 
where A(t) and B(t) are continuous and A(t) is bounded on [0, oc). Suppose the 
origin is an exponentially stable equilibrium point of the nominal system 
i= A(t)x 
and 

B(t) ^ 0 as t — œ 
From Theorem 4.12, we know that there is a quadratic Lyapunov function V({t,z)= 
x? P(t)x that satisfies (9.3) through (9.5) globally. The perturbation term B(t)x 
satisfies the inequality 
HBe € BON liec 


Since ||B(t)|| — 0 as t — oo, we conclude from Corollary 9.1 and the second case 
of Lemma 9.5 that the origin is a globally exponentially stable equilibrium point of 
the perturbed system. A 


Similar conclusions can be drawn when dns |B(t)|| dt < oo (Exercise 9.15) and 
fo IBF dt < oo (Exercise 9.16). 


In the case of nonvanishing perturbations, that is, when ó(t) Æ 0, the next 
lemma states a number of conclusions concerning the asymptotic behavior of x(t) 
as t — oc. 
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Lemma 9.6 Suppose the conditions of Lemma 9.4 are satisfied, and let x(t) denote 
the solution of the perturbed system (9.1). 


1. If : 
| eet- S(r) dr <B, Yt fo 
to 
for some positive constant B, then x(t) is uniformly ultimately bounded with 


the ultimate bound " uod 
2c8 


where 0 € (0,1) is an arbitrary constant. 


2. Ij 
! lin 6(t) = f% > 0 


t—oo 
then x(t) is uniformly ultimately bounded with the ultimate bound 
a C4500 


ne 2ac10 i 


where 0 € (0.1) is an arbitrary constant. 


3. If TES 
lim 6(t) =0, then lim a(t) =0 
t=% t—0oo 
If the conditions of Lemma 9.4 are satisfied globally, then. the foregoing iiS 
hold for any initial state z(to). 


Proof: All three cases follow easily from inequality (9.23). In the first pere 
we use the property that if u(t) = w(t) +a vith a > 0 and lim, ae i = aa 
u(t) is ultimately bounded by:a/0 for any positive 0 < 1. This is d da r 
is a finite time T such that |w(t)| < a(1 — 0)/0 for all t 2 T. In the last two cases, 


we usc the property that if u(t) = me exp(-a(t — r))w(r) dr where w(t) is bounded 
and limi oo u(t) = Woo; then lim, u(t) = wala! 


9.4 Continuity of Solutions on the Infinite Interval 


In Section 3.2, we studied continuous dependence of the solution of the state = 
tion on initial states and parameters. In particular, in Theorem 3.4, we exam 


the nominal system pea (9.26) 


7Sec [33. Theorem 3.3.2.33]. 
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and the perturbed system of the set Q. When the nominal system (9.26) is autonomous, the function V is 
provided by (the converse Lyapunov) Theorem 4.17 and the set N can be any com- 
pact subset of the region of attraction. Exponential stability is used only locally 


when the error z(t) — y(t) is sufficiently small. 


t= f(t,z) + g(t, z) (9.27) 


under the assumption that ||g(t,x)|} € 5 in the domain of interest. Using the 
Gronwall-Bellman inequality, we found that if y(t) and z(t) are well-defined solu- 
tions of the nominal and perturbed systems, respectively, then 


Ane vee tte 


s Proof of Theorem 9.1: The derivative of V along the trajectories of the per- 
lt) — «Oll & luto) — z(to)llexpLL(t — to)] 7 (explL(t—19))-1) — (8:28) turbed system (9.27) satisfies 
where L is a Lipschitz constant for f. This bound is valid only on compact time y- T + oV f(t,z) + PEL z) € -Ws(z) + 6 
intervals, since the exponential term exp(L(t — to)] grows unbounded as t — oo. In t ôr Ox 

fact, the bound is useful only on an interval [to, t1] where t is reasonably small, for 
if t1 is large, the bound will be too large to be of any use. This is not surprising, 
because in Section 3.2, we did not impose any stability conditions on the system. 


In this section, we use Lemma 9.4 to calculate a bound on the error between the 


concn tT mate cH a SIS Rune cn 


for all z,€ {Wi(x).<.c}; where kı is an upper bound on ƏV/ðx over {Wi( 

7 * "9. he fee BETS z) < 
c}. Let ka > 0 be the minimum of W3(x) over the compact set A = i < 
c and W2(z) 2 c). Then cu pes 


PUD DI SAI DI I 4. 


solutions of (9.26) and (9.27) that is valid uniformly in £ for all t > to. y : 

(9.26) and (9.27) aniformly V € -3Wa(z) - bka + bó € -3Wa(s), Vx e A, Vex P 
p Theorem 9.1 Let D'C R^ be domain that contains the origin and suppose 2k 
E F m , 
, 4 e f (t, z) and its first partial derivatives with respect to x are continuous, bounded, This shows that V is negative on V(t, æ) = c; hence the set (V (t,x) S c) is positively 
M and Lipschitz in z, uniformly in t, for all (t, z) € (0, oc) x Do, for every com- invariant. Therefore, for all 2(to) € (Wa(z) < c), the solution z(t) of (9.27) is 
x: pact set Dp C D; uniformly bounded. Since 9 is in the interior of (Wa(z) < c), there is.) > 0 
P such that z(to) € (Wa(z) < c) whenever y(to) € Q and ||z(to) — y(to)]| € wa. It is 


e g(t,x) is piecewise continuous in t, locally Lipschitz in x, and also clear that for y(to) € Q, y(t) is uniformly bounded and y(t) + 0 as t + 00, 


Y 


c , uniformly in to. The error e(t) = z(t) — i i 
d llg(&.z)]| € & V (t,x) € [0, o0) x D (9.29) MURS E e(t) = z(t) — y(t) satisfies the equation 
D é—i-jcf(tz)-9(52)— f(ty) = f(te) + A(t 
E e -the origin x = 0 is an exponentially stable equilibrium point of the nominal (52) 7 Hew) = fie) + Alte) + oft, 2) (9.31) 
wl system (9.26); where 
2 A(t,e) = f(t, y(t) +e) - f(t y(t 
E e there is a Lyapunov function V(t,x) that satisfies the conditions of Theo- , dd M) — fte) 
£ rem 4.9 for the nominal system (9.26) for (t,x) € [0,oc) x D and {W1 (z) < c} We analyze the error equation (9.31) over the ball {llel <r} C D. Equation (9 31) 
e is a compact subset of D. \ s can be viewed as a perturbation of the system a i 
p Let y(t) -and z(t) denote solutions of the nominal system (9.26) and the perturbed  é-jf(te) 
> system (9.27), respectively. Then, for each compact set €) C (Wa(z) € pe, 0 < i 
E p< 1), there exist positive constants D, Y, n, p, and k, independent of ô, such that whose origin is exponentially stable. By Theorem 4.14, there exi 
E if y(to) ENQ, 5 < n, and |[z(to) — y(to)l| < x, the solutions y(t) and z(t) will be function V(t, e) that satisfies (9.3) through (9.5) for lel < En heads pin 
E uniformly bounded for all t > tọ > 0 and value theorem, the error term A; can be written as ad 
2d 5-1 (t-to) 
K z(t) — y(t)l| < ke? €? |[z(to) — y(to)ll + 88 (9.30) ofi a 
> Ailte) = | Ae ~ 9fi 
» M i(t,e) [see az (5^6) e 
z^ s ; : 
Y While the origin is exponentially stable, the Lyapunov function V is required to Meg <A < E Since the Jacobian matrix [Bf /02] is Lipschitz in z, uniformly E 
E satisfy the conditions of uniform asymptotic stability, rather than (the more strin- in f, the perturbation term (A + g) satisfies : 
ra gent) conditions of exponential stability. This provides less conservative estimates 
A(t, e) + e(t z)]] < Lillell? + Lallell lul +6 
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where y(t) — 0 as t — oc, uniformly in ty. Consequently, 
A(t, e) + g(t, z)ll € {Lira + Lelly (t0 lell + 6 
for all |le|| € rı < ro. This inequality takes the form (9.15) with 
Yt) = {Liri + Loly(t)l) and (086 


Given any E > 0, there is T) > 0 such that ||y(t)|| < &i for allt > to-- 71. Therefore, 
(9.20) is satisfied with 


t 
J 0 dr < (ex + ant — to) + Ti max Lalil 
to ; t2to 

By taking €, and rı small enough, we can satisfy (9.21). Thus, all the assumptions 
of Lemma 9.4 are satisfied and (9.30) follows from (9.23). Oo 


9.5 Interconnected Systems Sistemos, Mop. dos 

When we analyze the stability of a nonlinear dynamical system, the complexity 
of the analysis grows rapidly as the order of the system increases. This situation 
motivates us to look for ways to simplify the analysis. If the system can be modeled 
as an interconnection of lower order subsystems, then we may pursue the stability 
analysis in two steps. In the first step, we decompose the systein into smaller 
isolated subsystems by ignoring interconnections, and analyze the stability of each 
subsystem. In the second step, we combine our conclusions from the first step with 
information about the interconnections to draw conclusions about the stability of 
the interconnected system. In this section, we illustrate how this idea can be utilized 
in searching for Lyapunov functions for interconnected systems. 

Consider the interconnected system 


i= filtri) + gilt a) i-12,...,m (9.32) 


T 
where z; € RY, ni +° + nm = n, and z = [ET o ciue, . Suppose f; aud gi 
are smooth enough to ensure local existence and uniqueness of the solution for all 
initial conditions in a domain of interest, and that 


Fi(t,0)=0, g(60)-0, Vi 


so that the origin z = 0 is an equilibrium point of the system. Ignoring tlie inter- 
connection terms gi, the system decomposes into m isolated subsystems: 


ii = filt zi) (9.33) 


with each one having an equilibrium point at its origin z; = 0. We start by searching 
for Lyapunov functions that establish uniform asymptotic stability of the origin for 
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each isolated subsystem. Suppose this scarch has been successful and that, for cach 
subsystem, we have a positive definite decrescent Lyapunov function V;(t, zi) whose 
derivative along the trajectories of the isolated subsystem (9.33) is negative definite. 
The function 


V(t,z) e Y diW(tGz), di» 0 
i=) 


is a composite Lyapunov function for the collection of the m isolated subsystems 
for all values of the positive constants d;. Viewing the interconnected system (9.32) 
as a perturbation of the isolated subsystems (9.33), it is reasonable to try V(t, £) 
as a Lyapunov function candidate for (9.32). The derivative of V(t, z) along the 
trajectories of (9.32) is given by 


m 


; c. [0V OV Vi 
Vas) = Y [Fe + TE tttno| + 1 tarot 


The first term on the right-hand side is negative definite by virtue of the fact that 
V; is a Lyapunov function for the ith isolated subsystem, but the second term is, in 
general, indefinite. The situation is similar to our earlier investigation of perturbed 
systems in Section 9.1. Therefore, we nay approach the problem by performing 
worst case analysis where the term [0Vi/Ox;]gi is bounded by a nonnegative upper 
bound. Let us illustrate the idea by using quadratic-type Lyapunov functions, 
introduced in Section 9.1. Suppose that, for i = 1,2,...,m, Vi(t, x;) satisfies 


3 Oi | OVi ove a dllm 9.34) 
X as P620 S codi) ( 
Vi < Bioi(zi) (9.35) 
Ox; 


for all t > 0 and ||z|| < r for some positive constants a; and fi, where $i: R™ = R 
are positive definite and continuous. Furthermore, suppose that the interconnection 


` terms gi(£, z) satisfy the bound 


lait, £) S 2 vtl) (9.36) 


j=l 


for all ¢ > 0 and ||z|| « r for some nonnegative constants “ij. Then, the derivative 
of V(t,z) = Dra, diVi(t, 24) along the trajectories of the interconnected system 
(9.32) satisfies the inequality 


Vi(t,2) < Yu —aió (zi) + Y Biss Giles); (23) 
i=l j=l 
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The right-hand side is a quadratic form in $,..., m, which we rewrite as 
Y(t,z) < - 197 (DS + ST D)ó 


where 
o = [ói,-...ón]7, D = diag (di,...,dm) 


and S is an m x m matrix whose elements are defined by 


. f a Bri i=j 
Sij = (9.37) 
— Pi Nij, i#j 
If there is a positive diagonal matrix D such that 
DS+S™TD>0 


then V(t, x) is negative definite, since ¢(z) = 0 if and only if x = 0; recall that 
¢i(x;) is a positive definite function of x;. Thus, a sufficient condition for uniform 
asymptotic stability of the origin as an equilibrium point of the interconnected sys- 
tem is the existence of a positive diagonal matrix D such that DS + ST D is positive 
definite. The matrix S is special in that its off-diagonal elements are nonpositive. 
The next lemma applies to this class of matrices. 

Lemma 9.7 There exists a positive diagonal matriz D such that DS + STD is 
positive definite if and only if S is an M-matriz; that is, the leading principal 
minors of S are positive: 


$131 $12 c S 
$21 

det : >0, k=1,2,...,m 
Skl sea‘ eee Skk 


Proof: See [57]. 


The M-matrix condition can be interpreted as & requirement that the diagonal 
elements of S be “larger as a whole” than the off-diagonal elements. It can be seen 
(Exercise 9.22) that diagonally dominant matrices with nonpositive off-diagonal 
elements are M-matrices. The diagonal elements of S are measures of the “degree of 
stability” for the isolated subsystems in the sense that the constant a; gives a lower 
bound on the rate of decrease of the Lyapunov function V; with respect to ¢?(z;). 
The off-diagonal elements of S represent the “strength of the interconnections” in 
the sense that they give an upper bound on gi(t, x) with respect to $;(x;) for j = 
1,...,m. Thus, the M-matrix condition says that if the degrees of stability for the 
isolated subsystems are larger as a whole than the strength of the interconnections, 
then the interconnected system has a uniformly asymptotically stable equilibrium at 
the origin. We summarize our conclusion in the next theorem. 
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Theorem 9.2 Consider the system (9.32) and suppose there are positive definite 
decrescent Lyapunov functions V;(t, 2;) that satisfy (9.34) and (9.35) and that g,(t, x) 
satisfies (9.36) for all t > 0 and ||z|| < r. Suppose the matriz S defined by (9.37) is 
an M-matriz. Then, the origin is uniformly asymptotically stable. Moreover, if all 
the assumptions hold globally and V;(t,;) are radially unbounded, it will be globally 
uniformly asymptotically stable. o 


Example 9.7 Consider the second-order system 


dj = -r -15ziz] 
iz = —zj- 0.522272 


The system can be represented in the form (9.32) with 
A(u)--n, n(z)--15z0j, fo(e2)=—2}, and g(r) = 0.52222 


The first isolated subsystem i; = —z, has a Lyapunov function Vi(z1) = 23/2, 
which satisfies i 
av a 


Ba, 7") = -z = =a% (21) 


where a, = 1 and ġı(z1) = |z,|. The second isolated subsystem £9 = —zj has a 
Lyapunov function V2(r2) = 24/4, which satisfies 


OV; 
C = —2§ = —asdi(z)) 


where az = 1 and ¢2(22) = |zo|*. The Lyapunov functions satisfy (9.35) with 
B = B» = 1. The interconnection term g; (z) satisfies the inequality 


lez) = 1.527 lea)? < 1.5c1ó2(z2) 
for all z1| < cı. The interconnection term 92(2) satisfies the inequality 
Ig2(x)| = 0.5123 < 0.5c cd (1) 
for all [zi| € cı and |zz| < ca. Thus, if we restrict our attention to the set 
G = {z € R? | |n| < ei, |z2| € c2} 
we can conclude that the interconnection terms satisfy (9.36) with 
"u70, «42-215, 44- obat, and 42520 


The matrix 
1 —1.5c? 


—0.5ei cd 1 


z 
7 
5 
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is an M-matrix if 0.75c]c? < 1. This will be the case, for example, when c = 
co = 1. Thus, the origin is asymptotically stable. If we are interested in estimating 
the region of attraction, we need to know the composite Lyapunov function V = 


dıVı + d2Vz; that is. we need to kuow a positive diagonal matrix D such that 
DS +S™D>0. Taking ci = co = 1, we have 


2d, —1.5d, — 0.5d; 
DS+S™D= 


—1.5d — 0.5d; 2d; 


which is positive definite for 1 < d/d} < 9. Since there is uo loss of generality in 
multiplying a Lyapunov function by a positive constant, we take d, = 1 and write 
the composite Lyapunov function as 


V(x) = bat + ldixj, 1 « di « 9 
An estimate of the region of attraction is given by 
Ne = (ze R? | V(z) Sc} 


where c € min {1/2,d2/4} to ensure that Qe is inside the rectangle |v;| < 1. 
Noting that the surface V(x) = c intersects the r;-axis and the z2-axis at V/2c 
and (4c/d2)/4, respectively, we maximize these distances by choosing dz = 2 and 


cz 0.5. A: 


Example 9.8 The mathematical model of an artificial neural network was pre- 
sented in Section 1.2.5, aud its stability properties were analyzed in Example 4.11 
by using LaSalle’s invariance principle. A key assumption in Example 4.11 is the 
symmetry requirement 7;; = Tj, which allows us to represent the right-hand side 
of the state equation as the gradient of a scalar function. Let us relax this require- 
ment and allow Tj; x: Tjj. We will analyze the stability properties of the network 
by viewing it as an interconnection of subsystems; each subsystem corresponds to 
one neuron. We find it convenient here to work with the voltages.at tlie amplifier 
inputs uj. The equations of motion are 


5 1 
Ciù; = Y Tus;(u) - Re +Í; 
j t 


fori = 1,2,...,n, where gi(:) are sigmoid functions, J; are constant current inputs, 
R; > 0, and C; > 0. We assume that the system has a finite number of isolated 
equilibrium points. Each equilibrium point v" satisfies the equation 


| ira 
0» Tgoj(u) - pul +h 
j 
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0 


Figure 9.1: The sector nonlinearity n:(x:) of Example 9.8. 


To analyze the stability properties of a given equilibrium point u*, we shift it to 
the origin. Let zx; = uj — uj. Then, 


Q|- 


ti = 


iod (aj uj) - (a ue 
ùi = D [3 i i) 


| 


Q 


1 1 
; frame Fal 
"L3 


where i 
niri) = gi(zi + ui) — gilu) 
Assume that 7;(-) satisfies the sector condition 
otk < omla) € o?ki, for o € f-ri r] 


iti i i 9.1 shows that such condition is 
where k;, and kiz are positive constants. Figure 
indeed satisfied when gi(ui) = (2Vm / 7) tan”! (Xru;/2Vy), A > 0. We can recast 
this system in the form (9.32) with 
lnt tanta), a) g enn 
fil) =- gt g ne gi(z) G » 1575 (25 


Using 
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as a Lyapunov function candidate for the ith isolated subsystem, we obtain 


1 
“ 5e )-- E^ + Tüzinizi) 
If T; € 0, then 
l * Tuzimi(zi) € -ITilkazi 
aud 


1 
BM fn) s = (az Talla) 


which is negative definite. If Ti; > 0, then 
Taxi (zi) € Takir? 


and 


OV; 1 
Da a filz) S- (x = uka) z? 
Ti 
In this case, we assume that Tyhiz < 1/ Ri, so that the derivative of Vj is negative 
definite. To simplify the notation, let 
[Tiki if Ti; «0 
b= 
-Tüki, if Ti; 250 


Then, V;(x;) satisfies (9.34) and (9.35) on the interval [l-r Ti] with 


1 
a= (x D ; Bi Ci éizi) = |zil 
where o; is positive by assumption. The interconnection term g;(z) satisfies the 
inequality 
lgi(z)| S a; X nuls zi < = CG L S [Tylk;alz;l 
j#i j#i 

Thus, g;(1) satisfies (9.36) with yi = 0 and yj = kja|T;;|/C; for i # j. Now we 
can form the matrix $ as 


ôi + 1/Ri, fori-j 
Sij B » " 

-[HTilkjz for i # j 
The equilibrium point u* is asymptotically stable if 5 is an M-matrix. We may 
estimate the region of attraction by the set 


Sane < eS 


i=1 


nen {ze 
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where c € 0.5 min;{diCir?} to ensure that Q is inside the set |z;| < r;. This anal- 


ysis is repeated for each asymptotically stable equilibrium point. The conclusions 
we could arrive at in this example are more conservative compared with the conclu- 
sions we arrived at using LaSalle's invariance principle. First, the interconnection 
coefficients T;; must be restricted to satisfy the M-matrix condition. Second, we 
obtain only local estimates of the regions of attractions for the isolated equilibrium 
points. The union of these estimates does not cover the whole domain of interest. 
On the other hand, we do not have to assume that Tiy; = Tj:. A 


9.6 Slowly Varying Systems 


The system 
£ = f(z, u(t)) (9.38) 


where z € R” and u(t) € T C R™ for all t > 0 is considered to be slowly varying if 
u(t) is continuously differentiable and ||ù(t)|| is “sufficiently” small. The components 
of u(t) could be input variables or time-varying parameters. In the analysis of 
(9.38), one usually treats u as a "frozen" parameter and assumes that for each 
fixed u = a ET, the frozen system has an isolated equilibrium point defined by 
x = h(a): If a property of z = h(a). is uniform in a, then it is reasonable to 
expect that the slowly varying system (9.38) will possess a similar property. The 
underlying characteristic of such systems is that the motion caused by changes 
of initial conditions is much faster than that caused by inputs or time-varying 
parameters. In this section, we will see how Lyapunov stability can be used to 
analyze slowly varying systems. 

Suppose f(z, u) is locally Lipschitz on R” xT, and for every u €T the equation 


O= f (z, u) 
has a continuously differéntiable isolated root z = h(u); that is, 


0 = f(h(u),u) 


Oh 
Ou 
To analyze the stability properties of the frozen equilibrium point z = h(a), we 
shift it to the origin via the change of variables z = z — h(a) to obtain the equation 


Furthermore, suppose 


<L, Vuer (9.39) 


4 = f(z + h(a) a) € g(z, o) (9.40) 


Now we search for a Lyapunov function to show that z = 0 is asymptotically stable. 
Since g(z, œ) depends on the parameter. a, a Lyapunov function for the system may 
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depend, in general. on a. Suppose we can find a Lyapunov function V(z, a) that 
satisfies the conditions 


allel? < V(z,a) < ea| zl? 


(9.41) 

2 (2,0) S -elizl? (9.42) 
| o < callzli (9.43) 
A < sliz? (9.44) 


for all z € D = {z € R" | |lzj| < r} and a € T, where Cj, i = 1,2,...,5 are 
positive constants independent of a. Inequalities (9.41) and (9.42) state the usual 
requirements that V be positive definite and decrescent and has a negative definite 
derivative along the trajectories of the system (9.40). Furthermore, they show that 
the origin z = 0 is exponentially stable. The special requirement here is that 
these inequalities hold uniformly in a. Inequalities (9.43) and (9.44) are needed 
to handle the perturbations of (9.40). which will result from the fact that u(t) is 
not constant, but a time-varying function. With V(z, u) as a Lyapunov function 


candidate, the analysis of (9.38) proceeds as follows: The change of variables z = 
` € — h(u) transforms (9.38) into the form 


i-g(zu)- Pha (9.45) 


where the effect of the time variation of u appears as a perturbation of the frozen 
system (9.40). The derivative of V(z,u) along the trajectories (9.45) is given by 


E . OV, OV, 

V = Oe" + a, 10 

av _ OV ah) y 

Ou  0zO0u 

~es lizh? + cs llalla (e) + cale Halte) 


ƏV 
zz ERG u) + | 
£ 
Setting ? 
v) = Lule) and t) = Lat) 
we can rewrite the last inequality as 
V < —callzl? + cay(t)llzll? + estu 
which takes the form of inequality (9.16) of Section 9.3. Therefore, by applying the 


comparison lemma, as in Section 9.3. it can be shown that, if u(t) satisfies 


: ce 
f là(r)| dr € &(t — to) +m. where € < 22 
ty 


n" 9.4 
C2€5 ( 6) 
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and ^ fu 
x MASS AS j ‘ < 
iic (0)]] < "PES lect) < PIA 


in which o4 and p; are defined by 


l|es C5 = (22) -] 
-—-i—-—z-—|2»0, =exp| 57] = 
ma 2 E Şi 2] Pı 20 


then z(t) satisfies the inequality 


L ; =Q it-T > : 
ONS Ealo RA [emma an (047) 


Depending upon the assumptions for ||2]|, several conclusions cau be e i 
the foregoing inequality. Some of these conclusions are stated in the next theorem. 


Theorem 9.3 Consider the system (9.45). Suppose that [0h/Ou) satisfies joe 
l&(t)| € e for all t > 0, and there is a Lyapunov function V(z,u) that satisfies 
(9.41) through (9.44). If aum . 

x ——— 
coc, rc c4L/e5 


then for all ||z(0)|| < r/ei/cz, the solutions of (9.45) are uniformly bounded for all 
t > 0 and uniformly ultimately bounded by 


c2c4 Le 
(ci €3 — EC2Cs) 


= 


where 0 € (0,1) is an arbitrary constant. If, in a H » 0 p t eer 
l j 7 = llu € T ande < c3/cs, m 
t 0 as t — œ. Finally, if h(u) = 0 for a ee 
: hi exponentially stable equilibrium point of (9.45). Equivalently, £ = 0 is a 
exponentially stable equilibrium point of (9.38). 


Proof: Since ||u(¢)|| < € < c1c3/c2cs. inequality (9.46) is satisfied with £1 = £ and 
m = 0. Hence, : 


Using the given upper bound on £, we have 


Qqoir car EE 
"aL cable. (a 
-F c T 
> ar[e oy | 
cal {cg cz tt cab/cs 
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= e X ————— 2€ 
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Hence, the inequality sup,;o ||à(£)]| < 2e1o17/c4Z is satisfied and from (9.47), we 


obtain 
t 
c2 -eit caL -eait-7) 
iz() < yz Ole r i. ° e dr 
c2 -at tle _ £ —e 4 pi 
< Eisen + BE = fee o 


After a finite time, the exponentially decaying term will be less than (1—0)b, which 
shows that z(t) will be ultimately bounded by b. If, in addition, u(t) — 0 as t — oo, 
then it is clear from (9.47) that z(t) + 0 as t — oo. If h(u) = 0 for all u € T, we 
can take L — 0. Consequently, the upper bound on V simplifies to 


V < - (ea — cse)ljz|? 
which shows that z = 0 will be exponentially stable if € < c3/cs. n 


Theorem 9.3 requires the existence of a Lyapunov function V (z, a) for the frozen 
system (9.40), which satisfies inequalities (9.41) through (9.44). Lemma 9.8 shows 
that such Lyapunov function will exist, under some mild smoothness requirements, 
if the equilibrium point z = 0 of the frozen system is exponentially stable uniformly 
in o. This is done by deriving a converse Lyapunov function for the system, as in 
the converse Lyapunov theorems of Section 4.7. 


Lemma 9.8 Consider the system (9.40) and suppose g(2, a) is continuously differ- 
entiable and the Jacobian matrices [09/02] and (8g/0a] satisfy 


< Lallzl 


0g 
3a 9) 


ô 
lace. a) < Li, 
for all (z,a)¢€ D xT, where D = {z € R^ | |jz|| <r}. Let k, y, and ro be positive 
constants with ro < r/k, and define Dg = {z € R^ | lz < ro). Assume that the 
trajectories of the system satisfy —— \ 


lIz(¢)|| < klz()le ?*, V 2(0) € Do, a eT, t20 


Then, there is a function V : Do xT — R that satisfies (9.41) through (9.44). 
Moreover, if all the assumptions hold globally (in z), then V(z,a) is defined and 
satisfies (9.41) through (9.44) on R” x T. o 


Proof: Owing to the equivalence of norms, it is sufficient to prove the lemma 
for the 2-norm. Let $(i;z,a) be the solution of (9.40) that starts at (0, z); that 
is, $(0;z, o) = z. The notation emphasizes the dependence of the solution on the 
parameter a. Let 


à i 
V(zo)- f à? (t; z, a) p(t; z, a) dt 


eS 


g 3 
Dd 59, à . . teas aie Pam PR senator cimi agen E mma te ihe 


20 tm Au o6 em RV Bonet 


9.6. SLOWLY VARYING SYSTEMS 


where T = In(2k?)/2y. Similar to the proof of Theorem 4.14, i 
: .14, it can be shown 

that V (z, o) satisfies (9.41) through (9.43) with c, = [1 — exp (-2Z4AT)]/2I4, c = 
: Jn" Sve c3 = n and c4 = 2k(1 — exp[—(y — Z1)7])/(» — Ly) 
o show that V(z, a) satisfies (9.44), note that the itivi i ;2,0) 
satisfies the sensitivity equation aa 


ð ô ð 
gte = Fe (6n a), o)óa + ECC 2,0),0), $a(0;z,0) =0 


from which we obtain 


t l " 
Iléa(tiz,e)ll2 < n Li|éa(r; z, a)l dr + n Lolé(r; z, a)l dr 


IA 


d i 
n Liéa(riz,a)|a dr + f Loke™™ dr||z|| 
0 


I^ 


n LyMa(riz,a)l dr + Zap, 


Use of the Gronwall-Bellman inequality yields 


Lok 
" lóa 6 z a)ll2 < F lelje" 
Hence, 
8V| | iTar 
all, = n 267 (t; z, o)da (t5 z, 0) dt l 
T 
E Lok 
< [kee (28) «at, à 
2k? La 
— e7(7-L)T def 
ya ig eT] het E cse 
which completes the proof of the lemma. ; a 


When the frozen system (9.40) is linear, a L i 
n (9. ; & Lyapunov function satisfying (9.41 
through (9.44) can be explicitly determined by solving a Hepes era iud ie 
equation. This fact is stated in the next lemma. j 


pio 9.9 Bra the system z = A(a)z, where a €T and A(a) is continu- 
isty Gijjerenttabie. Suppose the elements of A and their first j ivati 
with respect to œ are uniformly bounded: that is, à DO 


a 
lAa) Se, A| <b, Yacer, vViSism 


2 
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Suppose further that A(a) is Hurwitz uniformly in a; that is, 
Re[A(A(a)) € -0 «0, Yacer 
Then, the Lyapunov equation ` 
PA(a) + AT(a)P = —I (9.48) 


has a unique positive definite solution P(a) for every a € T. Moreover, P(a) is 
continuously differentiable and satisfies 


e127 2 < zT P(a)z € cox] z 
8 
8a, \ 


for all (z, à) € R” xT, where c1, co, and pi are positive constants independent of 
a. Consequently, V(z, o) = z" P(a)z satisfies (9.42) through (9.44) in the 2-norm 
with c3 = 1, c4 = 205, and es = V} ini Hi o 


Sui, Visism 
2 


Proof: The uniform Hurwitz property g Ala) implies that the exponential matrix 
exp [£A(a)] satisfies 


lexp[tA(o)]ll € k(A)e“™, Yt>0, Vaer 
where @ > 0 is independent of a, but k(A) > 0 depends on a. For the exponentially 
decaying bound to hold uniformly in a, we need to use the property that ||A(a)]| 
is bounded. The set of matrices satisfying Re[\(A(a))] € -ø and ||A(a)|| x c is 


a compact set, which we denote by S. Let A and B be any two elements of S. 
Consider? 


exp[t( A + B)] = exp{tA] + [ exp[(t — 7) A]B exp[r(A + B)] dr 
Using the exponentially decaying bound on exp[tA], we get 
llexp[t(A + B)||| < k(A)e7^' + f i k(A)e-P*-7)|Bl| ||exp[r(A + B)JI| dr 
Multiply through by eft, 
«00 exp IEÇA + B) < KCA) + H(A) BI ePrllexois(A + B) dr 


®This matrix identity follows by writing ¢ = (A + B)z ast = Az + Bx and viewing Bz as an 
input term. Substituting x(t) = exp[t(A + B)]zo into the input term yields 


t 
exp[t(A + B))zo = expitA]zo + I exp[(t — 7)4]B exp[r(A + B)]xo dr 
0 


Since this expression holds for all ro € R", we arrive at the matrix identity. 
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Applying the Grouvall-Bellinan inequality yields 
| exptt(A + B) S k(Aye- 7 NB! Yt > 0 


Hence, there exists a positive constant + « J and a neighborhood N(A) of A such 


that if C € N(A). then 
lexpitC]l s kee. vtz0 


Since S is compact. it is covered by a finite mimber of these neighborhoods. There- | 
fore, we cau find a positive constant k indepeudeut of œ such that 


lexpitA(a)]l < ke7. vt 20, Vaer 


Consider now the Lyapunov equation (9.48). Existence of a unique positive definite 
solution for every a € I follows from Theorem 4.6. Moreover, the proof of that 


theorem shows that 
x T 
P af za] [erac] ge 
a= j [p [e 


Since Á(a) is continuously differentiable, so is P(o). We have 
2 


r oc L2 k 
2 P(o): € Í Kem? Jo) dt = = lali ai 
Let y(t) = ez. Then. y = A(a)y. 
-y7 (ijy) = -y7 (Ala)y(t) € Alal  (0w() < cy” (t)y(t) 
and 


zT P(a)z 


x ^ -1 7 
[anoaz [| Fred 


: Ed, p : 1 f oo 
= = ff Sly" Og] dt = 5 [-7 (09(0] |, 


l T ee ae 
= gY (O0) eer coy 


Differentiate P(a)A(a)+ AT (a)P(a) = —I partially with respect to any component 
a; of a, and denote the derivative of P(a) by P'(a). Then, 


P'(a)A(a) + A7 (a)P'( a) = -(P(a)4 (2) + [A’(a) |” Pla)} 
Thus, P'(a) is given by 


P'(a) = l [ee] {P(a)A'(a) + [A’(a)|7 P(a)} [e tA co} dt 
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It follows that 
i k? bikt b,k* 
2,-24t I P MEE Nu 
IP a)l < [ k?e 7^ y dt= 2i = Wy 2 


which completes the proof of the lemma. a 

It should be noted that the set I' in Lemma 9.9 is not necessarily compact. When 
T is compact, the boundedness of A(a) and its partial derivatives follow from the 
assumption that A(a) is continuously differentiable. 


Example 9.9 Consider the system 
z= A(et)z 


where € > 0. When c is sufficiently small, we can treat this system as a slowly 
varying system. It is in the form of (9.38) with u = et and T = [0,00). For all 
u € T, the origin z = 0 is an equilibrium point. Hence, this is a special case where 
h(u) = 0. Suppose Re[A(A(a))] < -a < 0, and A(a) and A'(o) are uniformly 
bounded for all a € T. Then, the solution of the Lyapunov equation (9.48) holds 
the properties stated in Lemma 9.9. Using V(z,u) — zT P(u)r as a Lyapunov 
function candidate for £ = A(u)z, we obtain 


zT [P(u(t))A(u(t)) + AT (u(t)) P(u(£))]z + 27 P'(u())(Dz 


Vit, 2) 
—2' x + ecsllzl} = —(1—ecs)|lall3 


l^ It 


where cs is an upper bound on ||P’(a)||2. Therefore, for all € < 1/cs, the origin 
x = 0 is an exponentially stable equilibrium point of $ = A(et)z. A 


9.7 Exercises 


9.1 ([150]) Consider the Lyapunov equation PA4 ATP = -Q, where Q = QT > 
0 and A is Hurwitz. Let u(Q) = Amin(Q)/Amax(P). 


(a) Show that (kQ) = p(Q) for any positive constant k. 
(b) Let Ô = Q7 > 0 have Anis (Q) = 1. Show that p(I) > u(Q). 
(c) Show that (I) > u(Q), V Q = Q7 > 0. 


Hint: In part (b), let P; and Pz be the solutions of the Lyapunov equation for Q =I 
and Q = Q, respectively. Show that ' 


P,- P= E expl AT) — Q)exp(At) dt < 0 


-— Musa mL d w'n‘ a 
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9.2 Consider the system ¢ = Ax + Bu and let u = —Fr be a stabilizing state 
feedback control; that is, the matrix (A — BF) is Hurwitz. Suppose that, due to 


physical limitations, we have to use a limiter to limit the value of u; to |u;(t)| € L. 


The closed-loop system can be represented by ¢ = Az — BL sat(Fz/L), where 


sat(v) is a vector whose ith component is the saturation function. By adding and ° 


subtracting the term BF, we can rewrite the closed-loop state equation as $ = 
(A~ BF): — Bh(Fz), where h(v) = L sat(v/ L) — v. Thus, the effect of the limiter 
can be viewed as a perturbation of the nominal system without the limiter. - 


(a) Show that 
ó 
hi < —— |v: : 
lhi(v)| < TET lvi], V |ui] € L(1 + ô) 
` where ô > Q. 
(b) Let P be the solution of 
P(A- BF) + (A—- BF)TP = ~I 


Show that the derivative of V(x) = zT Pz along the trajectories of the closed- 
loop system will be negative definite over the region ((Fz) € L(1 +ô), V i, 
provided à/(1 + 6) < 1/(2]||PB||; ||F]z). 


(c) Show, that the origin is asymptotically stable and discuss how you would esti- 
mate the region of attraction. 


(d) Apply the result obtained in part (c) to the case 
0 1 0] 
a= faak ale s-|1]. F=[1 2], and L=1 
and estimate the region of attraction. 
9.3 Consider the system 
£=f(t,z)+Bu, y=Cz, and u= -—g(t,y) 


where f(t, 0) = 0, 9(1,0) = 0, and [[s(t, y)|| € yllyl| for all t > 0. Suppose that the 
origin of ¢ = f(t, x) is globally exponentially stable and let V(t, £) be a Lyapunov 
function that satisfies (9.3) through (9.5) globally. Find a bound y* on y such that 
the origin of the given system is globally exponentially stable for y < y*. 


9.4 Consider the perturbed system : ' 
t = Ar B[u + g(t, x) 


where g(t, £) is continuously differentiable and satisfies ||g(t, z)la S kllzll2, Vt > 
0, V z € B, for some r > 0. Let P = PT > 0 be the solution of the Riccati equation 


PA-- ATP Q— PBBTP +2aP=0 


a 
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where Q > k?I and a > 0. Show that u = -BTp ili iei 
perturbed system. z stabilizes the origin of the 


9.5 ([101]) Consider the perturbed system 
i = Art + Bu + Dg(t,y) y-OCz 
where g(t, y) is continuously differentiable and satisfies 
, g(t <k Vt> 
V ly € r for some r > 0. Suppose the equation Nin Maes 
1 a 
PA+ ATP + 6Q-=PBBTP+*PDD™P ++CTC =0 
? Y 


= or 
e =Q >0,¢>0,and0<y7< l/k has a positive definite solution 
= > 0. Show that u = ~(1/2e)B7 Pr stabilizes the origin of the perturbed 
system. 
9.6 Consider the system 
2) = ax ~ wag + (br - "yt2)(x? + 22) 
$2 = wti- az + (yzi + Br2)(x? + z2) 
where a > 0, A, 7, and w > 0 are constants. 
(a) By viewing this system as a perturbation of the linear system 
f, = -QT = wa, i2 = wz, — arg 


show that the origin of the perturbed system is exponentially stable with 
(lizllz S r} included in the region of attraction, provided |6| and |v| are 
sufficiently small, Find upper bounds on |G| and |»| in terms of r. 


(b) Using V(x) = z? + z2 as a Lyapunov function candidate for the perturbed 
system, show that the origin is globally exponentially stable when 8 € 0 and 


exponentially stable with (|x||; < /o/8) included in the region of attraction 
when 5 > 0. 


(c) Compare the results of (a) and (b) and comment on the conservative nature of 
the result of (a). 


: 9.7 Consider the perturbed system 


€ = f(z) + 9(z) 


Suppose the origin of the nominal system $ = f (x) is asymptotically (but not 
exponentially) stable. Show that, for any > 0, there is a function g(x) satisfying 
llg(z)] € »llz|| in some neighborhood of the origin such that the origin of the 
perturbed system is unstable. 
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9.8 ([66]) Consider the perturbed system 
è= f(x) + g(z) 


where f(z) and g(z) are continuously differentiable and ||g(z)] < ^|z|| for all 
\|z|| <.r. Suppose the origin of the nominal system $ = f(z) is asymptotically stable 
and there is a Lyapunov function V(x) that satisfies inequalities (9.11) through 
(9.13) for all ||z|| <r. Let Q = (V(x) € c}, with e < oi(7). 


(a) Show that there is a positive constant y* such that, for y < y", the solutions of 
the perturbed system starting in Q stay in Q for all t > 0 and are ultimately 
bounded by a class K function of y. 


(b) Suppose the noininal systei has the additional property that A= [Af /Az](0) 
is Hurwitz. Show that there is yf such that, for y < yj, the solutions of the 
perturbed system starting in 2 converge to the origin as t — oc. 


(c) Would (b) hold if A was not Hurwitz? Consider 


—23 — (221 + z3)? zı — 23 — (22, + z3)? 
‘f(z)= Tl . g(r) =a 0 „a#0 


I2 0 


Hint: For the example of part (c). use. ` 
V(z) 24 id + la? +2123 


to show that the origin of 2 = f(r) is asymptotically stable and then apply Theo- 
rem 4.16 to obtain a Lyapunov function that satisfies (9.11) through (9.13). \ 


9.9 Consider the system 
te r? tri yra tee r? a tolei te) OS <4 


(a) With y = 0, show that the origin is globally asymptotically stable. Is it expo- 
nentially stable? 


MROD ALACRA RACARARARNRARARAR, 


B 
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(b) With 0 < y < 1/2, show that tle origin is unstable and the solutions of the 
system are globally ultimately bounded by an ultimate bound that is a class 
K function of y. 


9.10 ([19]) Consider the system : 


| 
f 
| 
| 


dj x3, £2 = —asinz, — bz; — erg — (cx + 222) + g(t) costi 


where a, b > a, c, and y are positive constants and q(t) is a continuous function. 
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(a) With q(t) = 0, use 
V(x) = (b+ 12) z? + criza + 23 + 2a(1 — cos) 
to show that the origin is globally exponentially stable. 
(b) Study the stability of the system when q(t) # 0 and la(£)| € k for all t > 0. 
9.11 Consider the system 
i= ((sin z2)? - 1] Tı, 2-2 —bz, — (1 + b)z2 
(a) With b = 0, show that the origin is exponentially stable and globally asymp- 


totically stable. 


(b) With b 4 0, show that the origin is exponentially stable for sufficiently small 
|b], but not globally asymptotically stable, no matter how small |5| is. 


(c) Discuss the results of parts (a) and (b) in view of the robustness results of 
Section 9.1, and show that when b = 0 the origin is not globally exponentially 
stable. 

9.12 ([8]) Consider the system 
2, = —-2, + (xy +a)z2, t = —zi(zi +a) + brz, [ERU 

(a) Let b = 0. Show that the origin is globally asymptotically stable. Is it expo- 

` nentially stable? 

(b) Let b > 0. Show that the origin is exponentially stable for b < min(1,a?). 

(c) Show that the origin is not ‘globally asymptotically stable for any b > 0. 


(d) Discuss the results of parts (a) through (c) in view of the robustness results of 
Section 9.1, and show that when 5 = 0 the origin is not globally exponentially 
stable. 


Hint: In part (d), note that the Jacobian matrix of the nominal system is not 
globally bounded. 


9.13 Consider the scalar system $ = —z/(1-- 2?) and V(x) = z^. 
(a) Show that inequalities (9.11) through (9.13) are satisfied globally with 


4 
år 3 


a(r) =a:(r)=rf; as(r) = Ip a(r) = 4r 


(b) Verify that these functions belong to class Koo- 
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(c) Show that the right-hand side of (9.14) approaches zero as r — co. 


(d) Consider the perturbed system $ = —z/(1- z?) + 6, where 6 is a positive 
constant. Show that whenever ô > 1/2, the solution z(t) escapes to co for 
any initial state z(0). 


9.14 Verify that DYW (t) satisfies (9.17) when V = 0. 
Hint: Show that V(t + A, z(t + h)) € 0.5c4h?|l9(t,0)|? + A o(h), where o(h)/h + 0 
as h — 0. Then, use the fact that 4/c4/2c; > 1. 


9.15 Consider the linear system of Example 9.6, but change the assumption on 
B(t) to f," ||B(t)|| dt < oo. Show that the origin is exponentially stable. 


9.16 Consider the linear system of Example 9.6, but change the assumption on 


B(t) to [7^ ||B(t)|* dt < oo. Show that the origin is exponentially stable. 
Hint: Use the inequality 


b b 
[wo as yfo-0 f v(t) dt, V v(t) >0 


which follows from the Cauchy-Schwartz inequality. 


9.17 Consider the system $ = A(t)z where A(t) is continuous. Suppose lim:—oo A(t) = 


A exists and A is Hurwitz. Show that the origin is exponentially stable. 
9.18 Repeat part(b) of Exercise 9.10 when q(t) is bounded and q(t) — 0 as t + co. 


9.19 Consider the system 2 = f(t, x), where ||f(t,z)— f(0,2)]lo < *Y(£)||xlla for all 
t 20, z € R^, y(t) +0 ast — co, 


f (0,2) = Ax - (z2 + 23)Ba, a-[ 72 =| pel ^ 2| 


. and a, f, w, 2 are positive constants. Show that the origin is globally exponentially 


stable. 


9.20 Consider the system £ = f(x) + G(z)u+ w(t), where ||w(2)]g € atc ent. 
Suppose there exist a symmetric positive definite matrix P, a Positive semidefinite 
function W(x), and positive constants y and ø such that 


22T P f(x) + 42" Pa + W(x) - 2ez'PG(z)GT(z)Pz <0, Vz eR" 


Show that with u = —oGT(z)Pz, the trajectories of the closed-loop system are 
uniformly ultimately bounded by 2ak\max(P)/YAmin(P), for some k > 1. 
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9.21 Consider the perturbed system (9.1). Suppose there is a Lyapunov func- 
tion V(t, x) that satisfies (9.11) through (9.13), and the perturbation term satisfies 
llo(t,x)|| € 6(t), Vt 2 0, V x € D. Show that for any £ > 0 and A > Q, there exist 
n > 0 and p > 0 such that whenever (1/A) jS 6(r) dr <n, every solution of the 
perturbed system with |z(to)]| < p will satisfy ||x(t)|| < e, V t > to. 

(This result is known as totel stability in the presence of perturbation that is 
bounded in the mean [107].) 

Hint: Choose W = VV, discretize the time interval with sampling points at tp 4- iA 
for i = 0,1,2,..., and show that W (tọ + iA) satisfies the difference inequality 


W (to + (6+ 1)A) € e7^^W (to + iA) + kd - 


9.22 Let A be an n x n matrix with aj; < 0 for all i # j and aj; > > 
1,2,...,n. Show that A is an M-matrix. 
Hint: Show that Pede aj; > 0 for i =1,...,n, and use mathematical induction to 
show that all the leading principal minors are positive. 


jai laij], i= 


9.23 Suppose the conditions of Theorem 9.3 are satisfied with ` 
$i) = [il] and calli] S Vi(t, 24) < cillzil 

Show that the origin is exponentially stable. 

9.24 ([132]) Study the stability of the origin of the system 

ij-2-z)-l5n|z| t2 = -z3 + rêr? 
by using composite Lyapunov analysis. 
9.25 Study the stability of the origin of the system 
ii = 22+ T23, $= ~r- 0-3], $= i432 — x] 

by using composite Lyapunov analysis. 


9.26 Consider the linear interconnected system 
m 72 
bi = Auzi + X Aigz;, i=1,2,...,m 
f j=l;jži 
‘where, for each i, z; is an n;-dimensional vector and A; is a Hurwitz matrix. Study 
the stability of the origin by using composite Lyapunov analysis. 


9.27 ([175]) Complex interconnected systems could be subject to structural per- 
turbations that cause groups of subsystems to be connected or disconnected from 
each other during operation. Such structural perturbations can be represented as 


£; = fi(t. zi) + gi( eimi... eimTm), 1=1,2,...,m 
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where e;; is a binary variable that takes the value 1 when the jth subsystem acts 
on the ith subsystein and the value 0 otherwise. The origin of the interconnected 
systein is said to be connectively asymptotically stable if it is asymplotically stable 
for all interconnection patterns. that is. for all possible values of the binary variables 
eij. Suppose that all the assumptions of Theorem 9.2 are satisfied, with (9.36) taking 
the form 


i=l 
Show that the origin is conuectively asymptotically stable. 
9.28 ([49]) The output y(t) of the linear system 
g=Ar+Bu, y=Cz 
is required to track a reference input r. Consider the integral controller 
ż=r- 0r, u=—Fy\x— Foz 


where we have assumed that the state x can be measured and the matrices F, and 
F can be designed such that the matrix 


A-BF, -BF 
-C 0 


is Hurwitz. 
(a) Show that if r = constant, then y(t) — r as t — oo. 
i b) Study the tracking properties of the system when r(t) is a slowly varying input. 
9.29 ([86]) The output y(t) of the nonlinear system 
t= fizu) y= h(s) 
is required to track a reference input r. Consider the integral controller 
i-r-h(r) u=7(2,2,7) 


where we have assumed that the state x can be measured, the function y can be 


designed such that tlie closed-loop system 
| è= f(z,7(z,2,7)), — àer-h(z) 


has an exponentially stable equilibrium point (£, 2), and the functions f. k, and y 
are twice continuously differentiable in their arguments. 


k + 
(a) Show that if r = constant and the initial state (x(0), z(0)) is sufficiently close 
to (2, 2). then y(t) > r ast > 2c. 
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(b) Study the tracking properties of the system when r(t) is a slowly varying input. 


9.30 ([86]) Consider the tracking problem of Exercise 9.29, but P that we 
can only measure y = h(z). Consider the observer-based integral controller 


a= flau) + Gly- ha), #2=7-y and u= (21,2257) 
Suppose y and G can be designed such that the closed-loop system has an expo- 


Bos ] ; h 
nentially stable equilibrium point (2, Z1, Z2). Study the tracking properties of the 


system when 
(1) r = constant. 


9.31 Consider the linear system ż = A(t)x where ||A(t)|| < k and pa 
of A(t) satisfy Re[A(t)] € —¢ for all t 2 0. Suppose that fo |A(t)|I° dt S p. 
that the origin of ż = A(t)z is exponentially stable. 


(2) r(t) is slowly varying. 


Chapter 10 


Perturbation Theory and Averaging — 


Exact closed-form analytic solutions of nonlinear differential equations are possible 
only for a limited number of special classes of differential equations. In general, 
we have to resort to approximate solutions. There are two distinct categories of 
approximation methods that engineers and scientists should have at their disposal as 
they analyze nonlinear systems: (1) numerical solution methods and (2) asymptotic 
methods. In this and the next chapter, we introduce the reader to some asymptotic 
methods for'the analysis of nonlinear differential equations. ! 
Suppose we are given the state equation 


i= f(t,z,e) 


where € is a “small” scalar parameter, and, under certain conditions, the equation 
has an exact solution z(t,s). Equations of this type are encountered in many ap- 
plications. The goal of an asymptotic method is to obtain an approximate solution 
£(t,£) such that the approximation error x(t,¢) ~ Z(t,&) is small, in some norm, 
for small |e| and the approximate solution Z(t, ¢) is expressed in terms of equations 
simpler than the original equation. The practical significance of asymptotic meth- 
ods is in revealing underlying structural properties possessed by the original state 
equation for small |e]. We will see, in Section 10.1, examples where asymptotic 
methods reveal a weak coupling structure among isolated subsystems or the struc- 
ture of a weakly nonlinear system. More important, asymptotic methods reveal 
multiple-time-scale structures inherent in many practical problems. Quite often, 
the solution of the state equation exhibits the phenomenon that some variables 
move in time faster than other variables, leading to the classification of variables 
as "slow" and "fast." Both the averaging method of this chapter and the singular 


perturbation method of the next chapter deal with the interaction of slow and fast 
variables. 


ess aMMa 
‘Numerical solution methods are not studied in this textbook on the premise that most students 


are introduced to them in elementary differential equation courses and they get their in-depth study 
of the subject in numerical analysis courses. 
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Section 10.1 presents the classical perturbation method of seeking an approxi- 
mate solution as a finite Taylor expansion of the exact solution. The asymptotic 
validity of the approximation is established in Section 10.1 on finite time intervals 
and in Section 10.2 on the infinite-time interval. Section 10.3 examines an au- 
tonomous system under the influence of a weak periodic perturbation. While the 
results of the first three sections are interesting in their own sake, they provide the 
technical basis for the averaging method. In Section 10.4, we introduce the aver- 
aging method in its simplest form, which is sometimes called “periodic averaging” 
since the right-hand side function is periodic in time. Section 10.5 gives an applica- 
tion of the averaging method to the study of periodic solutions of weakly nonlinear 
second-order systems. Finally, we present a more general form of the averaging 
method in Section 10.6. 


10.1 The Perturbation Method 


Consider the system 
a= f(t,z,e) (10.1) 


where f : [to, t1] x D x [—€0, €9] + R" is "sufficiently smooth” in its arguments over 
a domain D C R”. The required smoothness conditions will be spelled out as we 
proceed. Suppose we want to solve the state equation (10.1) for a given initial state 


z(to) = n(e). (10.2) 


where, for more generality, we allow the initial state to depend “smoothly” on 
€. The solution of (10.1) and (10.2) depends on the parameter c, a point that we 
emphasize by writing the solution as x(t,€). The goal of the perturbation method is 
to exploit the “smallness” of the perturbation parameter & to construct approximate 
solutions that are valid for sufficiently small |z|. The simplest approximation results 


by setting € = 0 in (10.1) and (10.2) to obtain the nominal or unperturbed problem 


£-f(tz,0)  z(to)- m (10.3) 


where 7o = 7(0). Suppose this problem has a unique solution zo(t) defined on 
[£0, t1] and zo(f) € D for all t € [f,¢,]. Suppose further that f is continuous in 
(t, z,&) and locally Lipschitz in (z, €), uniformly in t, and 77 is locally Lipschitz in € 
for (£,z, €) in [to, t1] x D x [—e0, &o]. The closeness of the solutions of the perturbed 
and unperturbed problems follows from continuity of solutions with respect to initial 
states and parameters. In particular, Theorem 3.5 shows that there is a positive 
constant € € €g such that for all |e| € £1, the problem of (10.1) and (10.2) has 
a unique solution z(ft,&) defined on [to,t:]. Furthermore, Theorem 3.4 shows that 
there is à positive constant k such that 


l(t, €) — xo(£)]| € klel, V lel < ex, Vt € [toti] (10.4) 
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When the approximation error satisfies the bound of (10.4), we say that the error 


is of order O(c) and write 
x(t, £) — xo(t) = O(e) 


This order of maguitude notation will be used frequently in this chapter and tlie 
next one. It is defined next. 


Definition 10.1 (e) = O(ós(&)) if there exist positive constants k and c such that 
Idi (e)| € kléa(e), V lel «c 


Example 10.1 
e £” = O(e™) for all n > m, since 
e|" = le] em < lel", V lel «1 
e £?/(0.5 + €) = O(e?), since 


eg, vl|e| «a «0.5 


05a! 


e 1+2e = O(1), since 


[12-22] « 1--2a, V Je| «a 


e exp(—a/e) with positive a and z is O(e") for any positive integer n, since 


er (Dye, ve»o 


A 


What can we say about the numerical value of the approximation error z(t, €) — 
zo(t) for a given numerical value of € when the error is O(e)? Unfortunately, we 
cannot translate the O(e) order uf inaguitude statement iuto a uumerical bound 
on the error. Knowing that the error is O(c) means that its norm is less than 
k|e| for some positive constant k that is independent of e. However, we do not 
know the value of k, which might be 1, 10, or any positive number.” The fact that 
k is independent of € guarantees that the bound &|e| decreases monotonically as 
jel decreases. Therefore, for sufficiently. small |e|, the error will be small. More 
precisely, given any tolerance 6, we kuow that the norm of the error will be less 


21¢ should be noted, however, that in a well-formulated perturbation problem where variables 
are normalized to have dimensionless state variables, time, and perturbation parameter, one should 
expect the numerical value of k not to be much larger than one, See Example 10.4 for further 
discussion of normalization, or consult [98] and (141] for more examples. 


Si 


CCEC CECO 


5 a bcd Ri AN ara AR 


EET EPOD ep - 


— 


B 
| tna. 


ne$$s$S?e*e9?9t*eeececececeetcteeneercctcte 


RURSUS OP UN IS IAB BRS 


e 


P 


384 


than 6 for all |e| < 6/k. If this range is too small to cover the numerical values of 
interest for £, we then need to extend the range of validity by obtaining a higher 
order approximation. An O(c?) approximation will meet the same 6 tolerance for 
all jel < ./4/k2, an O(e?) approximation will do it for all |e| < (5/k3)'/%, and so 
on. Although the constants k,k2,k3,... are not necessarily equal, these intervals 
are increasing in length, since the tolerance à is typically much smaller than one. 
Another way to look at higher order approximations is to see that, for a given 
"sufficiently small” value of e, an O(e") error will be smaller than an O(e™) error 


for n > m, since "e 
kilel” (2) SA 
«1, Vie| € | = 

ks|e|" lel ky 

Higher-order approximations for solutions of (10.1) and (10.2) can be obtained 

in a straightforward manner, provided the functions f and 7 are sufficiently smooth. 

Suppose f and 7 have continuous partial derivatives with respect to (x, €) up to order 

N for (t,2,€) € [to, ti] x D x [7&o,&o). To obtain a higher order approximation of 
a(t, c), we construct a finite Taylor series 


N-1 
a(t,e)= V^ ex(t)e* +e" Re(t,e) (10.5) 
k=0 
Two things need to be done here. First, we need to calculate the terms Zo, 21, 
..., ZN-1; in the process of doing that, it will be shown that these terms are well 
defined. Second, we need to show that the remainder term R, is well defined and 
bounded on [to, £1], which will establish that SA zy (t)e" is an O(g") (Nth-order) 
approximation of z(t,€). By Taylor's theorem,? the smoothness requirement on the 
initial state n(e) guarantees the existence of a finite Taylor series for n(&); that is, 


N-1 
nle) = » ne" + e" Rale) 
k=0 


Therefore, 
zlto) =m, k=0,1,2,...,.N—-1 


Substituting (10.5) into (10.1) yields 


N-1 ` 
F ielej +e" helte) = f(bz(Se)e) Z hlte) 
g N-1 
= M he(t)e* e" Ra(t.e) (10.6) 
k=0 


where the coefficients of the Taylor series of h(t, €) are functions of the coefficients of 
the Taylor series of z(t, €). Since (10.6) holds for all sufficiently small e, it must hold 


38ee [10, Theorem 5-14]. 
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as an identity in e. Hence, coefficients of like powers of e must be equal. Matching 


those coefficients, we can derive the equations that must be satisfied by ao, x1, and 
? , : 


so on. Before we do that, we have to generate the c i 
; coefficients of th i 
of h(t, c). The zeroth-order term ho(t) is given by PRESES 


ho(t) = f(t, za(t), 0) 
Consequently, matching coefficients of €? in (10.6), we determine that zo(t) satisfies 
to = f(t,20,0),  zo(to) = mo 


which, not surprisingly, is the unperturb 
POLE p m ed problem (10.3). The first-order term 


ml) = Zf(sa(he)e) 


e=Q 


of G 
= (Lean, ee) mt, e)+ a(t ehe)} 


e=0 


à 
= Gin.) 21) + S 2,0 


Matching coefficients of € in (10.6), we find that Z(t) satisfies 


. [] 
= 2, zo(t),0) zı + 2. o(t),0),  zi(to)m m 
Define 
A(t) = OF 8f 
Oz (t, zo(t), 0), g(t, zo(t)) = Be É Toli), 0) 


and rewrite the equation for zı as 


tı = A(t)zi + 91(t, zo(t)), zi(io) =m 


oe equation has a unique solution defined on [to, t1]. 

26 an can be tithe to derive the equations satisfied by £2, 73, and 
- this, however, will involve higher order differential i sect i 
which makes the notation cumbe T i PEE e 

) rsome. There is no point in writi i 

in a general form. Once the idea is cl Vui ri S 

ear, we can generate the equations f 

Specific problem of interest. Neverthel loe equ 
: ess, to set the pattern that th i 

take, we will, at the risk of bori i s nbn 

à e oring some readers, derive the equati 
second-order coefficient in the Taylor series of h(t, €) is given by cannes 


18 
= Lap €) 


ha(t) = 2 ðe? " 
ES 


H 
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Now, 
ð ð 
aee = FE t, m,e) ÊZ alte) + S (6a, e) 
| of ô 
= Be (tt) [ea (t) + 2ezo(t) +--+] + Pt 2,2) 


To simplify the notation, let 


p(t, z€) = 2, M £) x(t) 


and continue to calculate the second derivative of h with respect to e: 


2 
a h(t,e) = Fe (base) Els, €) + +291 => (t,z,€) Pu 
«22! q, £5 dud: NIAE e) Fite) 


ef 
+ ga (8) +e d ] 
Thus, 
ha(t) = A(t)zo( t) + g2(t, zo(t), zi(t)) 
where 
18 8 à 
g2(t, zo(t) z1 (t)) = 5 Ct, zoli), 0) ry (t) + ác 2 Sq, Zo(t), 0) zi(t) 
18?f 
+ 28g ^ zo(t), 0) 
Matching coefficients of &? in (10. 6) y ields 
= A(t)x2 + ga(t,Zo(t),1(t)),  Za(to) = m 
In summary, the Taylor series coefficients zo, 21, ..., £w-; are obtained by 
solving the equations 
Zo = f(t, Xo, 0), zo(to) = flo (10.7) 
= A(t)zk + gx(t, xo(t),... iXk-i(t),  Tklto) = m (10.8) 


for k = 1,2,..., N — 1, where A(t) is the Jacobian [8f/8z] evaluated at z = 
Zo(t) and € = 0, and the term gz(t, ro(t),21(t),...,2%—1(t)) is a polynomial in 
21,...,€&—1 With coefficients depending continuously on t and zo(t). The assump- 
tion that zo(t) is defined on [to, t1] implies that A(t) is defined on the same interval; 
hence, the linear equations (10.8) have unique solutions defined on [to, t1]. Let 
us now illustrate the calculation of the Taylor series coefficients by a second-order 
example. 
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Example 10.2 Consider the Van der Pol state equation 
i = T3. zı(0) = th (e) 


i2 -z +e(1—x?)z2, 22(0) = me) 


Suppose we want to construct a finite Taylor series with N = 3. Let 
Ti = Tio +ETi + e? riz + &&,, i1-1,2 
and 
Ni = Nio + Eni t E^ nia E RS, i 1,2 
Substituting the series for z; and z2 into the state equation results in 


Zip €$11 + £i T ERa, = X29 +ET2 + &z3 T E? Rra 
i20 + E21 + €?) $22 + Re, 


2 3 
—i190—€211—€' 212— € Rr, 
+e [1 — (210 TEX + £)12 t eR, 
X (T20 + £221 + €?22 + E Rr) 


` Matching coefficients of e°, we obtain 


, 


Zio = Tæ.  zi(0 = mo 
bw = =r Tæ(0) = Nan 
which is the unperturbed problein at £ = 0. Matching coefficients of £. we obtain 
tu = fas zu(0 = mi 
in = -zn-c(l-:r1)z25 za(0 = "a 


while matching coefficients of €? results in 


fig = 222, zi(0) = m» 

in = ~x + (l-—r19)tai — 23102311220, z22(0) = me 
The latter two sets of equations are in the bim of (10.8) fork 21,2. ` A 
Having calculated the terms Zo, Ti; ..., ZN-1, OUr task now is to show that 


s zi (t)e* is indeed an O(c) approximation of z(t,£). Consider the approxi- 


mation error 
i N-1 


e-z- Y zy(t)* (10.9) 


k=0 


. 
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i i t and substituting for the deriva- 
i iating both sides of (10.9) with respect to e : 
en unis, from (10.1), (10.7), and (10.8), it can be shown that e satisfies the 


equation 


è= Alte + pilt,e,E) + pale), elto) = €” Ryle) (10.10) 
where : 
»» Ó X k e) — A(t)e 
mes = fte » zy(t)e*,e) - f(t D zy (t)e*,€) 
N-1 k N-1 IA) (t) 4 2xC)] el 
pte) = f(t 2 ax(t)e*,e) — F(t, zalt), 0) - 2, Ath 


By assumption, x(t) is bounded and belongs to D " ue € Eo al pie a 
i h that for all |lel] € ^ and le} S €1, the funct ; 

us A AC VON -1 : k l compact subset of D. It can be 
Dea z,(£)e*, and e + Dyno vk(t)e^ belong to a comp 

easily verified that 


| pilt,0,e) = 0 (10.11) 
lolt ene) — pilt e &)ll S killez — el (10.12) 
llez(t, eI < kate] (10.13) 


iti d ks. 
for all t € [to, ti], €, 62 € Ba, E E [7&, €1], for some positive constants kı and ke 
Equation (10.10) can be viewed as a perturbation of 


êo = A(t)eo + pilt, e0, E); eo(to) =0 (10.14) 


i i = to,tı]. Applying Theorem 3.5 
which has the unique solution eo(t,€) = 0 for t € [to, i 
on iai (10.10) has a unique solution defined on (to, tı] for sufficiently small |e] 
Applying Theorem 3.4 shows that 


N 
lle(t, &)]] = lle(t, €) — eo(t, £) = Oe") 
We summarize our conclusion in the next theorem. 
Theorem 10.1 Suppose 


e f and its partial derivatives with respect to (x, ¢) up to order N are continuous 
in (t,x,€) for (t,z,€) € [to, ti] x Dx [-€0; Eo]; 


e 7 and its derivatives up to order N are continuous for € € [—€0,€0]; 


e the nominal problem given in (10.3) has a unique solution xo(t) defined on 
[to, tı] and zo(t) € D for all t € [to, t1]. 


————À: ENNC — — d 


n——(—— — nó (s m 
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Then, there exists e* > 0 such that V |e| < e*, the problem given by (10.1) and 
(10.2) has a unique solution x(t,e), defined on (to, ti], which satisfies 


N-1 


z(t,e) — X zy(t)e* = O(eN) 
k=0 

o 
When we approximate z(,c) by xo(t), we need not know the value of the pa- 
rameter e, which could be an unknown parameter that represents deviations of the 
system’s parameters from their nominal values. When we use a higher order ap- 
proximation pi 2,(t)e* for N > 2, we need to know the value of € to construct 
the series, even though we do not need it to calculate the terms 23, Z2, and so on. If 
we have to know £ to construct the Taylor series approximation, we must then com- 
pare the computational effort needed to approximate the solution via a Taylor series 
with the effort needed to calculate the exact solution. The exact solution a(t,e) can 
be obtained by solving the nonlinear state equation (10.1), while the approximate 
solution is obtained by solving the nonlinear state equation (10.7) and a number of 
linear state equations (10.8), depending on the order of the approximation. Since, 
in both cases, we have to solve a nonlinear state equation of order n, we must ask 
ourselves, What do we gain by solving (10.7) instead of (10.1)? One situation where 
the Taylor sezjes approximation will be clearly preferable is the case when the solu- 
tion is sought for several values of €. In the Taylor series approximation, equations 
(10.7) and (10.8) will be solved only once; then, different Taylor expansions will be 
constructed for different values of e. Aside from this special (repeated values of £) 

case, we find the Taylor series approximation to be effective when 


* the unperturbed state equation (10.7) is considerably simpler than the 
€-dependent state equation (10.1), and 


e € is reasonably small that an "acceptable" approximation can be achieved 
with a few terms in the series. 


In most engineering applications of the perturbation method, adequate approxima- 
tions are achieved with N = 2 or 3, and the process of setting € = 0 simplifies 
the state equation considerably. In the next two examples, we look at two typical 
cases where setting € = 0 reduces the complexity of the state equation. In the 
first example, we consider again the Van der Pol equation of Example 10.2, which 
represents a wide class of “weakly nonlinear systems" that become linear at € = 0. 
To construct a Taylor series approximation, we only solve linear equations. In the 
second example, we look at a system formed of interconnected subsystems with 
"weak" or €-coupling. At € = 0, the system decomposes into lower order decoupled 
subsystems. To construct a Taylor series approximation, we always solve lower or- 


der decoupled equations as opposed to solving the original higher order equation 
(10.1). 


A rae ed 
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Figure 10.1: Example 10.3 at ¢ = 0.1: (a) zi(t,&) (solid) and 219(t) (dashed); (b) 
z1(t,&) — zio(t) (solid) and z; (t, €) — zio(t) — &xi1(t) (dashed). 
Example 10.3 Suppose we want to solve the Van der Pol equation 

i = T2, z,(0) = 1 

$9 = ~2,+e(1-—2?)zo, z2(0) = 0 


over the time interval [0,7]. We start by setting € = 0 to obtain the linear unper- 
turbed equation 


tio = 220, x9(0) = 1 

$29 = —Zi9, X20(0) = 0 
whose solution is 

Tio(t)=cost, z(t) = —sint 


Clearly, all the assumptions of Theorem 10.1 are satisfied, and we conclude that the 
approximation error z(t, €) — x(t) is O(e). Calculating x(t, ¢) numerically at three 
different values of € and using 


Eo = g lz(t,£) — xo(t)llo 


as a measure of the approximation error, we find that Eg = 0.0112, 0.0589, and 
0.1192 for € = 0.01, 0.05, and 0.1, respectively. These numbers show that the error 
is bounded by 1.2e for € < 0.1. Figure 10.1(a) shows the exact and approximate 
trajectories of the first component of the state vector when € = 0.1. Suppose we 
want to improve the approximation at € = 0.1. From Example 10.2, we know that 
X11 and z2; satisfy the equation 


H 
o 


iu = Za, 211 (0) 


LU 
(æ) 


fa -ru - (1 — f) sint, £2 (0) 


Figure 10.2: Electric circuit of Example 10.4. 


whose solution is 


zult) = - $sint- dj sin3t + Št cost 
zz(t) 3. cost ~ d ue stsint 


32 
By Theorem 10.1, the second-order approximation zo(t) + exi (t) is O(e?) close to 
the exact solution for sufficiently small e. To compare the approximate solution 
with the exact one at € = 0.1, we calculate 


1 


Ej- dex | (£, 0.1) — zo(t) — 0.1z1(t)|lo = 0.0057 


which shows a reduction in the approximation error by almost an order of magni- 
tude. Figure 10.1(b) shows the approximation errors in the first component of the 
state vector for the first-order approximation zg and the second-order approxima- 
tion zo + E71 ate = 0.1. . 


Example 10.4 The circuit shown in Figure 10.2 contains nonlinear resistors whose 
I-V characteristics are given by i = #(v). The differential equations for the voltages 


across the capacitors are 


' 1 
CM = EE) - 40) - gn m) 
OFF mE ct) ~ Wea) 7 rmm) 


The circuit has two similar RC sections connected through the resistor Re. When 
R. is “relatively large,” the connection between the two sections becomes "weak." 
In particular, when R, = co, the connection is open circuit and the two sections are 
decoupled from each other. This circuit lends itself to an e-coupling representation 
where the coupling between the two sections may be parameterized by a small 


^ 2 


1 
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parameter g. At first glance, it appears that a reasonable choice of e is € = 1/R.. 

Indeed, with this choice, the coupling terins in the foregoing equations will be 

multiplied by e. However, such a.choice makes € dependent on the absolute value of 
a physical parameter whose value, no matter how small or large, has no significance 

by itself without considering the values of other physical parameters in the system. 
In a well-formulated perturbation problem, the parameter € would be chosen as a 
ratio between physical parameters that reflects the “true smallness” of £ in a relative 
sense. To choose € this way, we usually start by choosing the state variables or the 
time variable (or both) as dimensionless quantities. In our circuit, the clear choice 
of state variables is v; and va. Instead of working with vı and vo, we scale them in 
such a way that the typical extreme values of the scaled variables would be close to 
+1. Due to the weak coupling between the two identical sections, it is reasonable 
to use the same scaling factor a for both state variables. Define the state variables 
as z) = v/a and z2 = v2/a. Taking a dimensionless time 7 = t/RC and writing 
dz/dr = t, we obtain the state equation 


E R R 
di "zm e —41-— o Poi) T. gn — z2) 
, E R R 
i9 = —-—19— a V (o2) = [A = zı) 


It appears now that a reasonable choice of € is R/Re. Suppose that R = 1.5 x 103 
Q, E = 1.2 V, and the nonlinear resistors are tunnel diodes with 


(v) = 107? x (17.76v — 103.79v? + 229.629 — 226.3104 + 83.72v°) 
Take a = 1 and rewrite the state equation as 
gy = 12-z-h(n)-s(z-22) 
dp = 12-22 -h(x2) — e(z2 — 21) 
where A(v) = 1.5 x 10? x v(v). Suppose we want to solve this equation for the 


initial state 
zi1(0) 20.15; %2(0) = 0.6 


Setting € = 0, we obtain the decoupled equations 


. 1.2— z1 —A(zx), zi(0) 0.15 


ll 
tT 


di 


ig = 1.2- 2 — h(z9). z,(0) = 0.6 


which are solved independently of each other. Let x19(t) and z20(t) be the solu- 
tions. According to Theorem 10.1, they provide an O(c) approximation of the exact 
solution for sufficiently small e. To obtain an O(c?) approximation, we set up the 
equations for 211 and 291 as 


in = —[1 +A'(x10(t))|eus — (r10(t) — zao(1)]; zu(0) = 0 


£n = —[1+A'(x20(t))|z21 — [z20(t) — io(£)), z3(0 = 0 


uat — 0 my 
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Figure 10.3: Exact solution (solid), first-order approximation (dashed), and second- 
order approximation (dash-dot) for Example 10.4 at £ = 0.3. 


where h'(-) is the derivative of h(-). Figure 10.3 shows the exact solution as well as 
the first-order and second-order approximations for ¢ = 0.3. A 


A serious limitation of Theorem 10.1 is that the O(c”) error bound i i 
only on finite (order O(1)) time intervals [to, t4]. It d hd ai veers 
[to T/e] nor on the infinite-time interyal [io o0). The reason is that the constant k 
in the bound k|e|N depends on t, in such a way that it grows unbounded as t; in- 
creases. In particular, since the constant k results from application of Theorem 3 4 
it has a component of the form exp(Lt1). In the next section, we will see how to 
employ stability conditions to extend Theorem 10.1 to the infinite interval. In the 
lack of such stability conditions, the approximation may not be valid for large t 
even though it is valid on O(1) time intervals. Figure 10.4 shows the exact and 
approximate solutions for the Van der Pol equation of Example 10.3, at € = 0.1 
M a large E edid For large t, the error 2; (t,¢) — z19(t) is no longer Ole). 

ore seriously, the error z1(t,£) — zjo(t) — idrisa 
consequence of the term d t à MS I M E LE 


10.2 Perturbation on the Infinite Interval 


The perturbation result of Theorem 10.1 can be extended to the infinite timei 

[to, co) under some additional stability conditions. In the a ieee de 
the nominal system (10.7) to have an exponentially stable equilibrium point at the 
origin and use a Lyapunov function to estimate its region of attraction. There is no 
loss of generality in taking the equilibrium point at the origin, since any equilibriu 
point can be shifted to the origin by a change of variables. D 


Theorem 10.2 Let D C R” be a domain that contains the origin and suppose 


Aion in Te 
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Figure 10.4: Exact solution (solid), first-order approximation (dash-dot), and second- 
order approximation (dashed) for the Van der Pol equation over a large time interval. 


e f and its partial derivatives with respect to (z,£) up to order N are continuous 
and bounded for (t,x,€) € [0,00) x Do x [—€0,é0], for every compact set 
Do C D; if N =1, [Of /Oz](t, x, €) is Lipschitz in (z,&), uniformly in t; 


e 7 and its derivatives up to order N are continuous for & € [—&o, £o]; 


e the origin is an exponentially stable equilibrium point of the nominal system 
(10.7); 


e there is a Lyapunov function V(t,z) that dps the conditions of Theo- 
rem 4.9 for the nominal system (10.7) for (t,x) € [0,00) x D and (Wi(z) < c} 
is a compact subset of D. 


Then, for each compact set 2 C {Wa(x) < pc, O < p < 1}, there is a positive 
constant e* such that for all to > 0, mo € Q, and |e| < &*, equations (10.1) and 
(10.2) have a unique solution x(t,£), uniformly bounded on [to, oo). and 


N-1 
z(t,e) - 35 zelt)" = O(e%) ` 


where O(c") holds uniformly in t for all t > to. o 


If the nominal system (10.7) is autonomous, the set 2 in Theorem 10.2 can 
be any compact subset of the region of attraction of the origin. This is a conse- 
quence of (the converse Lyapunov) Theorem 4.17, since the Lyapunov function V (zx) 
provided by the theorem has the property that any compact subset of the region 
of attraction can be included in the interior of a compact set of the form (V (x) < c). 


Proof of Theorem 10.2: Application of Theorem 9.1 shows that there is £, > 0 
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such that for all |e| < £1, z(t,€) is uniformly bounded and z(t,£) — zo(t) is O(e), 
uniformly in t, for all ¢ > to. It is also clear that for no € Q, zo(£) is uniformly 
bounded and lim,... zo(t) = 0. Consider the linear equations (10.8). We know 
from bounded-input-bounded-output stability (Theorem 5.1) that the solution of 
(10.8) will be uniformly bounded if the origin of z-= A(t)z is exponentially stable 
and the input term gx is bounded. The input gy is a polynomial in 2, ..., 2-1 
with coefficients depending on t aud zo(t). The dependence on t comes through 
the partial derivatives of f, which are bounded on compact subsets of D. Since 
Zo(t) is bounded, the polynomial coefficients are bounded for all t > to. Hence, 
boundedness of gą will follow from boundedness of zi, ..., zy-1. The matrix A(t) 
is given by 


A(t) = ĈE, zolt),0) 


where xo(t) is the solution of the nominal system (10.7). It turns out that expo- 
nential stability of the origin as an equilibrium for (10.7) ensures that the origin of 
z = A(t)z will be exponentially stable for every solution xo(t) that starts in the set 
Q. To see this point, let 


Ao (t) — A (t, 0, 0) 


and write | 
def 


A(t) = Ao(t) + [A(t) — Ao(t)) = Ao(t) + B(t) 
so that the linear system z = A(t)z can be viewed as a linear perturbation of 
ý = Ao(t)y. Since [2f /Ox)(t, z, 0) is Lipschitz in z, uniformly in t, 


ie = [Last - Soo) < oft 


On the other hand, by exponential stability of the origin of (10.7) and Theorem 4.15, 
we know that the origin of the linear system y = Ao(t)y is exponentially stable. 
Therefore, similar to Example 9.6, we can use lim¿—oo Zo(t) = 0 to show that the 
origin of the linear system z = A(t)z is exponentially stable. 
Since ||zo(£)|| is bounded and gi(t, zo(t)) [8f /ðe](t, xo(t), 0), we see that g; is 
bounded for all t > tg. Hence, by Theorem 5.1, we conclude that z; (t) is bounded. 


By a simple induction argument, we can see that zo(t), ..., Tk-1(t) are bounded. 
So far, ha have verified that the exact solution a(t, e) and the approximate 
solutiori d zy(t)e" are uniformly bounded on [fo, 00) for Susident y small |e]. 


All that cum now is to analyze the approximation error e — z — prd. zy (t)eh. 
The error analysis is quite similar to what we have done in Section 10.1. The error 
satisfies (10.10), where p, and p» satisfy (10.11), (10.13) and 


[a 


(t,e,€)]] < i (llell + lel) 
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for sufficiently small £1. The error equation 


r all (t,e,€) € [to, oo x By x [-€1,¢1] 
aD Peay A(t)e, where the perturbation term 


(10.10) can be viewed as a perturbation of é = 
satisfies 
i N 
lli (t, e, €) + palt, Ii € Kx Cllell + leDllell + kalel" < ka (A + lel)llell + Falel 


, we conclude from Lemma 9.4 that, for sufficiently 


Noting that |le(to, €)|| = O(e%) y 


small |el, |le(t, €)|| = O(e") for all t > to. 
Example 10.5 The electric circuit of Example 10.4 is represented by 
i = 1.2- z —h(zı)- elti - ry) 
$9 = 12-22 —A(xe) — €(t2- 21) 
where 
h(v) = 1.5 (17.76v — 103.79v? + 229.62v* — 226.31v* + 83.729) 
At £ = 0, the unperturbed system comprises two isolated first-order subsystems: 


di 1.2- zı — A(z) 
£2 = 12- X2— h(x) 


It can be verified that each of the two systems has three equilibrium points at 0.063, 
0.285, and 0.884. The Jacobian —1 +h’ (z;) is negative at z; = 0.063 and z; = 0.884 
and. positive at x; = 0.285. Hence, the equilibrium points at 0.063 and 0.884 are 
exponentially stable, while the equilibrium point at 0.285 is unstable. When the two 
first-order systems are put together, the composite second-order system will have 
nine equilibrium points; only four of them will be exponentially stable. These are the 
equilibrium points (0.063, 0.063), (0.063, 0.884), (0.884, 0.063), and (0.884, 0.884). 
Theorem 10.2 says that if the initial state z(0) belongs to a compact subset of 
the region of attraction of any one of these equilibrium points, the approximation 
calculated in Example 10.4 will be valid for all t > 0. The simulation shown in 
Figure 10.3 was taken over a time interval long enough for the solution to reach 
steady state. In this particular case, the initial state (0.15,0.6) belongs to the 
region of attraction of (0.063, 0.884). A 


The O(e%) estimate of Theorem 10.2 is valid only when the origin is exponen- 
tially stable. It does not necessarily hold if it is asymptotically, but net exponen- 
tially, stable, as illustrated by the next example. 


Example 10.6 Consider the first-order system 


=r? t+er 
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and suppose ¢ > 0. The origin of the unperturbed system 
t= -T 


is globally asymptotically stable, but not exponentially stable. (See Example 4.23.) 
The perturbed system has three equilibrium points at z = 0 and z = +e. The 
equilibrium z = 0 is unstable, while the other two equilibria are asymptotically 
stable. Solving both systems with the same positive initial condition z(0) = a, it 
can be easily seen that : 


z(t,é) + vE and zo(t)—0 as t— oo 


Because y£ is not O(e), it is clear that the approximation error z(t, €) — zo(£) is not 
O(e) for all £ > 0. Nevertheless, since the origin is asymptotically stable, we should 
be able to make a statement about the asymptotic behavior of the approximation 
as t — oo. Indeed, we can make a statement, although it will be weaker than 
the statement of Theorem 10.2. Because the origin of the unperturbed system is 
asymptotically stable, the solution zo(t) tends to zero as t — 00; equivalently, given 
any ô > 0, there is T} > 0 such that 


IIzo(t)| < 8/2, vt2 T 


The solutions of the perturbed system are ultimately bounded by a bound that 
shrinks with.e. Therefore, given any ô > 0, there is T5 > 0 and &* > 0 such that 


lz(t,e) < 6/2, Vt>To, Ve «e" 


Combining these two estimates, we can say that for any ô > 0 the approximation 
error satisfies 

jx(t,e) —zo(t)|| <6, Vt>T, Ve«e* 
where T = max(Ti, T5). On the order O(1) time interval [0, T], we know from the 


finite time result of Theorem 10.1 that the approximation error is O(e). Therefore, 
we can say that for any 6 > 0, there is £'" > 0 such that 


date) — xo(t)|| «4, Vte[0,oo), Ve «e'* 


The last inequality is equivalent to saying that the approximation error tends to 
zero as € — 0, uniformly in £ for all t > 0, which is the best we can show, in general, 
in the lack of exponential stability. Of course, in this particular example, we can 
obtain both zo(t) and z(ż,€) in closed form, and we can actually show that the 
approximation error is O( /e). A 


10.3 Periodic Perturbation of Autonomous Systems 


Consider the system 
& = f(z) +eg(t,z,€) - (10.15) 


[d 
i 


NM 
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where f. g, and their first partial derivatives with respect to x are continuous and 
bounded for all (t,7.¢) € [0,0¢) x Da x [—£0.&o]. for every compact set Do C D. 
where D C R" is a domain that contains the origin. Suppose the origin is an 
exponentially stable equilibrium point of the autonoinous system 


t= f(z) (10.16) 


Equivalently, the matrix A = [9f /81)(0) is Hurwitz. Due to boundedness of g. we 
can use Theorem 4.14 and Lemma 9.2 to show that there exist r > 0 and £, > 0 
such that for all ||z(0)|| € r and |e| € zi. the solution of (10.15) is uniformly 


: ultimately bounded with ultimate bound proportional to |e|. In other words. all 


solutions approach an O(e) neighborhood of the origin as t — oo. This is true for 
any bounded g. In this section, we are interested in what happens inside that O(¢) 
neighborhood when g is T-periodic in t; that is. 


g(t +T,2,¢) = g(t,z,e), V (t x.£) € [0, œ) x D x [—€, €0] 


In particular, we are interested in the possibility that a T-periodic solution might 
exist within an O(e) neighborhood of the origin. 

Let ó(t;ío,zo,&€) be the solution of (10.15) that starts at (fo, zo); that is, r9 = 
(to; to, xo, €). For all [z]| < r, define a map P.(z) by 


P.(x) = $(T;0, 2, €) 
That is, P.(z) is the state of the system at tine T when the initial state at time 
zero is x, This map plays a key role in studying the existence of periodic solutions 
of (10.15). 
Lemma 10.1 Under the foregoing conditions, equation (10.15) has a T-periodic 
solution if and only if the equation 
z = Br) (10.17) 


has a solution. o 


Proof: Since g is T-periodic in t. the solution of (10.15) is invariant to time shifts 
that are integer multiples of T. In particular, 


é(t--T;T, r.c) = O(t:0,27,¢), Vt 0 (10.18) 
This can be seen by changing the time variable from ¢ to r = t — T, which yields 


dr 
q 7S0) ear + T, m,e) = f(a) egi z,e) 
‘The equivalence follows from Theorem 4.15. 
5This map can be interpreted [70, Section 4.1] as a Poincaré map of the (n + 1)-dimensional 
autonomous system i 
Pef(res rs G=1 
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On the other hand. by uniqueness of solution, we have 
e(t + T:0,2,€) = off + TT d(T;:0,2,2),6), V1 20 (10.19) 
'To prove sufficiency. let 
De = Pipe) = O(T;0, pe, €) 
Then 


olt +T;0.pe,€) = oft +T;T, G(T; 0, pe, €), €) 
= a(t + T;T, pe, €) 
= (t; 0, pe, E) l (10.20) 


where the first equality follows from (10.19) and the last equality from (10.18). 
Equation (10.20) shows that the solution starting at (0, pe) is T-periodic. To prove 
necessity, let Z(t) be a T-periodic solution of (10.15). Set y = £(0). Then 


é(t--T;0,y,:) = o(t;0,y,€), Vt20 


Taking t = 0 yields 
: $(7:0,y, £) = $(0;0,y,€) =y 


which shows that y is a solution of (10.17). ü 


Lemma 10.2 Under the foregoing conditions, there exist positive constants k and 


€q Such that (10.17) has a unique solution in ||x|| < k|e], for all |e| < e2. o 


Proof: At € = 0, ¢(t;0, z, 0) is the solution of the unperturbed system (10.16) 
starts at (0, x). Since x = 0 is an equilibrium point for (10.16), 0 = $(£;0,0,0) for 
all t 2 0. Hence, 

Py(0) = o(T;0,0,0) — 0 


From the implicit function theorem, it follows that if the Jacobian matrix 


r=0,e=0 


is nonsingular, then there is a positive constant £9 such that equation (10.17) has 
a unique solution pe in |e] < €2. To check nonsingularity of the Jacobian matrix, 
recall that the solution ¢(t;0,7,¢) is given by 


o(t;0,2,€) 2 z [ [f(d(7;0, 2, €)) + eg(7, O(7;0,2,€),€)] dr 
0 
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Differentiating with respect to £ yields 
0 * [0f ,, 06 0g, , 06 | 
: 2 Gl (y £9 (. 99 (y 99 (A d 
2 qnd =+ f SEO) eO e BO Be] A 


Let 


-ð 
U(t) = a; A650 2.8) sped 
Then, 
t t 
va =r [ Lowe e = 1+ [ Aver 
o 0 
and 


d 
=U = AU), U( - I 


Thus, U(t) = exp( At). Consequently, 


BP. 


2: = Į — exp( AT) 


r=(),e=0 


I 


Because A is Hurwitz, all eigenvalues of exp(AT) are strictly inside the unit circle. 
Consequently, J is nonsingular. Hence. (10.17) has a unique solution pe, V |e| < €2. 
On the other hand, since all solutions of (10.15) approach an O() neighborhood 
of the origin as ¢ — oo, it must be true that p, is O(c), because the corresponding 
periodic solution passes through pe infinitely many times as t — oo. 


It is now clear that, for sufficiently small e, the perturbed system (10.15) has 
a T-periodic solution in an O(s) neighborhood of the origin. Tn fact, this periodic 
solution has to be unique due to the uniqueness of the solution of equation (10.17). 
Using the Hurwitz property of A, we can go further to show that the periodic 
solution is exponentially stable. 


Lemma 10.3 Under the foregoing conditions, if Z(t, €) is a T-periodic solution of 
(10.15) such that ||z(t,&)l < kle|, then Z(t, €) is exponentially stable. o 


Proof: A systematic procedure to study the stability of Z(¢,¢) is to apply the 
change of variables z = x — Z(t,€) and study the stability of the equilibrium point 
at z = 0. The new variable z satisfies the equation 
à = f(z4 (58) — (E e) + elol z+ zlte) e) — g(t, z(t, e), e)! 
def ĝ 
= f(t,z) 


amaaa 
This js a well-known fact in sampled-data control theory. It can be proved by transforming A 
into its Jordan form. 


D 
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Linearization about z = 0 yields 


of 
Oz 


of 
Ox 


Og 


TE 
Oz 


z=0 


z=0 


a 
A+ Ege g)- a] + et z(t,e), e) 


z=0 


By continuity of [Of /8z), we know that for any ô > 0, there is £* > 0 such that 
ðf, 8 
[seen - Lo] <a 


for e < e*. Since A is Hurwitz and [8g, Zé) i 
g/0x](t, 2,7) is O(1), we conclude fr 
Lemma 9.1 that, for sufficiently small e, the linear system v : ix 


js [A + (Lean, e)- 4) +e (e206, 22] ^ 


has an exponentially stable equilibrium point at y — 0. Therefore, by Theorem 4.13 
z = 0 is an exponentially stable equilibrium point. o 


We summarize our findings in the next theorem. 
Theorem 10.3 Suppose 


e f, g, and their first partial derivatives with respect to x are continuous and 
bounded for all (t z,€) € [0, o0) x Do x [—-€o, £o]; for every compact set Do C D, 
where D C R" is a domain that contains the origin; 


e The origin 19 an exponential, stable equilibr 7um point of the autonomous 8y$- 


e g(t,z,&) is T-periodic in t. 


Then, there exist positive constants e* and k such that for all |e| < &*, equation 
(10.15) has a unique T-periodic solution z(t,e) with the property that |z(t,e)| € 
k|e]. Moreover, this solution is exponentially stable. o 


If g(t, 0,€) = 0, the origin will be an equilibrium point of the perturbed system 
(10.15). By uniqueness of the periodic solution Z(t,¢), it follows that Z(t,e) is 
the trivial solution z = 0. In this case, the theorem ensures that the origin is an 
exponentially stable equilibrium point of the perturbed system (10.15). 


2 
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10.4 Averaging 
The averaging method applies to a system of the form 
"gg mef(t.z.e) 
where £ is a small positive parameter and f(t. x,£) is T-periodic in t; that is, 
f(t-- T x, 2) = f(t,z,€), V (t, z,&) € [0.00) x D x [0, £0] 


for some domain D C R^, The method approximates the solution of this system 
by the solution of an “average system," obtained by averaging f(t,x,€) at € = 0. 
To motivate the averaging method, let us start by examining a scalar example. 


Example 10.7 Consider the first-order linear systein 
1(0) =n 


where € is a positive parameter, a is sufficiently smooth in its arguments, and 
a(t + T,£) = a(t,e) for all t > 0. To obtain an approximate solution that is valid 
for small e, we may apply the perturbation method, of Section 10.1. Setting € — 0 
results in the unperturbed systein 


t = a(t, &)z. (10.21) 


z=0, z(0-2m 


which has a constant solution ro(t) = n. According to Theorem 10.1. the error of 
this approximation will be O(e) on O(1) time intervals. The unperturbed system 
does not satisfy the conditions of Theorem 10.2. Therefore, it is not clear whether 
this approximation is valid on time intervals larger than O(1). Because in this 
example we can write down a closed-form expression for the exact solution, we will 
Moser the approximation error by direct calculations. The solution of (10.21) is 
given by 


t 
x(t.&) = exp Gi a(T,€) ar| n 
0 


Hence, the approximation error is: 


z(t,&e) - xo(t) = fox | | a(T,€) ar| - i} n 


To see how the approximation error behaves as t increases, we need to evaluate the 
integral term in the foregoing expression. The function a(t,¢) is periodic in t. Let 
its mean be 


2 1 f7 
a(e) = rf a(r, e) dr 
We can write a(t,&) as 


a(t.) = ü(e)  [a(f $9) — alel 


| 
i 
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The term inside the bracket is a T-periodic function of t with zero mean. Therefore, 
the integral 


f [a(r.£) — a(e)] dr W Alte) 


is T-periodic and, hence, bounded for all t > 0. On the other hard, the integration 
of the term ā(£) on [0, ¢] results in tā(e). Thus, 


2(t,e)  zo(t) = {exp leta(e)] exp [eA(t,€)] - 1}n 


Except for the case a(e) = 0, the approximation error will be O(€) only on O(1) 
time intervals. A careful examination of the approximation error suggests that a 
better approximation of z(t,c) is expleta(e)|7 or even exp[eta(0)]n, since G(e) — 
a(0) = O(e). Let us try Z(et) = expleta(0)]n as an alternative approximation. The 
approximation error is given by 


{exp [eta(e)] exp [eA (t, )] — expleta(0)]} n 
expleta(0)] (exp [et(a(e) — a(0))] exp [eA (5, &)] - 19 


z(t,e) — z(et) 


Noting that 


_ exp [eA(t,e)] = 1-40(&) Vt20 
exp[et(a(e) — a(0))] = expltO(e?)] = 1+ O(c), Vie 0, b/e] . 
expleta(0)] = O(1), Vee [0, b/e] 


for any finite b > 0, we conclude that z(t, €) — z(et) = O(e) on time intervals of order 
O(1/e), which confirms the conjecture that the approximation Z(et) = exp[eta(0)]n 
is better than the approximation zo(f) = 7. Note that (et) is the solution of the 


average system 


a(0) = 7 (10.22) 


whose right-hand side is the average of the right-hand side of (10.21) at € = 0. A 


i -eü(0)r. 


In this example, we have arrived at the average system (10.22) through our 
knowledge of the closed-form expression of the exact solution of (10.21). Such 
closed-form expressions are available only in very special cases. However, the plau- 
sibility of averaging is not dependent on the special features of the example. Let 
us reason the idea of averaging in a different way. The right-hand side of (10.21) 
is multiplied by a positive constant €. When e is small, the solution x will vary 
"slowly" with £ relative to the periodic fluctuation of a(t,c). It is intuitively clear 
that if the response of a system is much slower than the excitation, then such re- 
sponse will be determined predominantly by the average of the excitation. This 
intuition has its roots in linear system theory, where we know that if the bandwidth 
of the system is much smaller than the bandwidth of the input, then the system 
will act as a low-pass filter that rejects the high-frequency component of the input. 
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If the solution of (10.21) is determined predominantly by the average of the fluctu- 
ation of a(£,), then it is reasonable, in order to get an O(c) approximation, that 
the function a(t,&) be replaced by its average. This two-time-scale interpretation 
of averaging is not dependent on the special features of Example 10.7, nor is it 
dependent on the linearity of the system. It is a plausible idea that works in a more 
general setup, as we Shall see in the rest of the chapter. 

Consider the system 
i = ef (t,a,€) (10.23) 
where f and its partial derivatives with respect to (x,€) up to the second order are 
continuous and bounded for (£,2,£) € [0,00) x Do x (0, £o], for every compact set 
Do C D, where D C R” is a domain. Moreover, f(t, z, €) is T-periodic in ¢ for some 
T > 0 and e is positive. We associate with (10.23) an autonomous average system 


t= €fay(Z) (10.24) 


where A 
fav(z) = E Í f(T, 2,0) dr (10.25) 


The basic problem in the averaging method is to determine in what sense the 
behavior of the autonomous system (10.24) approximates the behavior of the nonau- 
tonomous system (10.23), We will address this problem by showing, via a change 
of variables, that the nonautonomous system (10.23) can be represented as a per- 
turbation of the autonomous system (10.24). Define 


u(t,z) = f Mss) de (10.26) 
0 
where E 


h(t, x) = f(t2,0) — fav(z) (10.27) 


Since A(t, x) is T-periodic in t and*has zero mean, the function u(t, x) is T-periodic 
in t. Hence, u(t, z) is bounded for\all (£z) € [0,00) x Do. Moreover, Ou/Ot and 
Ou/Oz, given by 


are T-periodic in t and bounded on [0, oc) x Do. Here, we have used the fact that 
Oh/Oz is T-periodic in t and has zero mean. Consider the change of variables 


z=yteu(t,y) (10.28) 
Differentiating both sides with respect to t, we obtain 


i= tes (ty) ren (hy) y 


i », 
*O777104.. ‘AVERAGING 


Substituting for à from (10.23), we find that the new state variable y satisfies the 
equation 


Ires y = ef(t,yteu,e) € 
ef (t, yTeu, £) = ef(t, V 0) F Efav(y) 
€fav(y) + &p(t y, €) 


def 


where 
p(t, y€) = [f(& y + eu,e) — f(t: y, &)] + [f(t y, £) — F(t, y, 0)] 


The function p(t, y,¢) is T-periodic in £ and, using mean value theorem, can be 
expressed as 
p(t, yE) = Fi(t,y,eu,e)eu + Fo(t y, &)e 


Because Ou/8y is bounded on [0,00) x Do, the matrix I + c0u/8y i i 
for sufficiently small e, and VQ nem 


[rege] ve I-4- O(c) 


Therefore, the state equation for y is given by 
ý = efav(y) + &^q(t, y, €) l (10.29) 


where q(t, y, €) is T-periodic in t and fav, q, and their first partial derivatives with 
respect to (y,€) are continuous and bounded on (0,00) x Do for sufficiently small 
e. This equation is a perturbation of the average system (10.24). By extending the 
arguments used in the previous three sections, we can determine the basis for ap- 


proximating the solutions of (10.29) by the solutions of the average system (10.24). — 


The change of time variable s = et transforms (10.29) into 


d 
F = foly) + ea(s/e ye) (10.30) 


where q(s/e, y, &) is éT-periodic in s and bounded on [0, oo) x Do for sufficiently 
small E. By applying Theorems 3.4 and 3.5 on continuity of solutions with respect 
to initial states and parameters, we see that if the average system 


d 
z = fa (y) 


has a unique solution g(s) defined on [0, b], g(s) € D for all s € [0,5], an 

30h: +0j; d 0, € _- 
Lay(0) = Of), then there exists £* > 0 such that for all 0 < € < 2 the eed 
system (10.30) will have a unique solution defined for all s € [0,5] and the two 
solutions will be O() close. Since t = s/e and z —y = O(e) by (10.28), the solution 
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of the average system (10.24) provides an O(¢) approximation for the solution of 
(10.23) over the time interval [0, 6/¢] in the t time scale. 

Suppose the average system (10.24) has an exponentially stable equilibrium 
point at the origin and D is a domain that contains the origin. Let V(y) be the 
Lyapunov function provided by (the converse Lyapunov) Theorem 4.17. Then, for 
any compact subset 2 of the region of attraction of the origin, there is a constant 
c > 0 such that Q lies in the interior of the compact set (V(y) € c). Suppose 
Vac (0) € N and y(0, €) — yav(0) = Ofe). Applying Theorem 9.1 shows that the O(e) 
approximation will be valid for all s > 0, that is, for all ¢ > 0. 

Finally, Theorem 10.3 shows that (10.30) has a unique, exponentially stable, 
(eT)-periodic solution §(3/¢,¢) in an O(e) neighborhood of the origin. The periodic 
solution has period eT in the s time scale, that is, period T in the t time scale. By 
(10.28), we see that (10.23) has a T-periodic solution 


Z(t, €) = y(t,&) + eu(t. g(t.e)) 


Because u is bounded, the periodic solution Z(t,¢) lies in an O(s) neighborhood of 
the origin. We summarize these conclusions in the next theorem. 


Theorem 10.4 Let f (t, x,£) and its partial derivatives with respect to (,£) up to 
the second order be continuous and bounded for (,x,&) € (0,00) x Do x [0, eo], for 
every compact set Dg C D, where D C R" is a domain. Suppose f is T-perivdic in 
t for some T > 0 and e is a positive parameter. Let r(t,€) aud Lay (zt) denote the 


solutions of (10.23) and (10.24), respectively. 


o If tav(et) € D V t € [0,b/e] and x(0,¢) — za,(0) = Ole), then there exists 
€* > 0 such that for all 0 < € < e", x(t,e) is defined and 


z(t,e) — Ta (st) = O(e) on [0, b/e] 


e If the origin x = 0 € D is an exponentially stable equilibrium point of the 
average system (10.24), Q C D is a compact subset of its region of attraction, 
Lav(0) € Q, and z(0,e) — z,,(0) = O(e), then there exists &' > 0 such that 
for all 0 < € < &*, x(t,e) is defined and 


z(t,€) — za (et) = Ole) for all t € [0, o0) 


e If the origin x = 0 € D is an exponentially stable equilibrium point of the 
average system (10.24), then there exist positive constants e* and k such that, 
for all 0 < € < e*, (10.23) has a unique, exponentially stoble, T-periodic 
solution z(t,&) with the property ||z(t,&)|| € ke. o 


If f(t,0,€) = 0 for all (t,£) € [0,00) x [0, o]. the origin will be an equilibrium 
point of (10.23). By the uniqueness of the T-periodic solution £(¢, €), it follows that 
F(t.) is the trivial solution x = 0. In this case, the theorem ensiires that the origin 
is an exponentially stable equilibrium point of (10.23). 
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Example 10.8 Consider the linear system 


i= eA(t)e 
where A(t + T) = A(t) and e > 0. Let 


MEM 
= d 
A [ A(r) dr 


The average system is given by E 
i-tÁÀr 

It has an equilibrium point at x = 0. Suppose the matrix A is erties er a 
follows from Theorem 10.4 that, for sufficiently small e, t = cA(t)x has a D ES 
periodic solution in an O (c) neighborhood of the origin c= 0. d sie diae 
equilibrium point for the system. Hence. the periodic solution is ex riyal: uis 
a(t) = 0. Consequently, we conclude that, for sufficiently sma "s yii HT he 
exponentially stable equilibrium point for the nonautonomous system i = 


Example 10.9 Cousider the scalar system 
à = e(zsin? t — 0.52?) = Ef (t, 2) 


The function f(t, x) is t-periodic in t. The average function fav(z) is given by 
Sy eee - 2 E slr- 22 
fav(z) = Ji (zsin? t — 0.52") dt 0 ( ) 


The average system g 2 
i =0.5e(x - z^) 


has two equilibrium points at z = 0 and x = 1. The Jacobian df, /dx evaluated at 


these equilibria is given by 


dav = (05-z),zo = 05 
dz |... 

EE (05—z)],4 = -05 
dz |. 


he system has an exponentially stable 7-periodic 


solution in an O(c) neighborhood of z 2 1. bei by aree ih 
i that the region of attraction of z = 1 1$ (997. f 
e : [a,b] C (0,00), solving the average system with 
1 system yields the approximation 


Thus, for sufficiently small €, t 


r-z, t 
initial states in the compact interval 
the same initial state as the origina 


a(t,é) — xa (Et) = Ofte), Vt20 
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Suppose we want to calculate a second-order approximation. We need to use the 
change of variables (10.28) to represent the problem as a standard perturbation 
problem and then proceed to approximate the solution, as we have done in Sec- 
tion 10.1. Using (10.26), we find that the function u(t, x) is given by 


t 2 
u(t,z) = T (xsin? r — 0.52? — 0.52 + 0.527) dr = —izsin2t 
0 


The change of variables of (10.28) takes the form 
z =y- ieysin2t = (1— lesin2t)y 
Differentiating both sides with respect to t, we obtain 


å = (1— }esin 2t) j — ey cos 2t 


Hence, . 
a +2 2 i 
y Japan a: etin t- 32 + iycos2t) 


Substituting z in term of y, and expanding the term 1/[1 — (e/4) sin 2t] in the power 


series l 
— v = 14 iesin% + O(e? 

E a OU) 
` we arrive at the equation 


y= àe(y -y)* is (ysindt + 2y? sin 2t) + O(e*) 


where the system appears as a perturbation of the average system. In order to find 
a second-order approximation, we need to calculate yg and y; in the finite Taylor 


series 
y =y tem +e? Ry 


We know that yo = Zav, the solution of the average system. The equation for y, is 


given by 
th =e [(} —yo(t)) m + volt) sin 4t + 249 (¢) sin 2¢]., (0) = 0 


where we have assumed that the initial state x(0) is independent of e. Using (10.28), 


we obtain a second-order approximation of z as 


a = (1— lesin20) zv (et) + eyi (t,£) + Ole?) 


Figure 10.5 shows the solution of the exact system, the average system, and the 
= 0.3. The figure illustrates 


clearly how the solution of the average system averages the exact solution. The 
second-order approximation is almost iudistinguishable from the exact solution, 


second-order approximation for z(0) = 0.7 and € 


but we can see the difference as the solution reaches steady state. 
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Figure 10.5: The exact (solid), average (dashed), and second-order (dash- i 
of Example 10.9 with e = 0.3. i pec oes 


Example 10.10 Consider the suspended pendulum of Section 1.2.1 and assume 
that the suspensign point is subjected to vertical vibrations of small amplitude and 
high frequency. Suppose the motion of the Suspension point is described by asinwt 
where a is the amplitude and w is the frequency. Writing Newton's law in the 
tangential direction (perpendicular to the rod), the equation of motion is" 


m(16 — aw? sinwt sin 8) = —mgsin6 — k(16 + aw cos wt sin 8) 


Assume that a/l < 1 and w/w < 1, where wy = Vall is the frequency of free 
oscillations of the pendulum in the vicinity of the lower equilibrium position 8 = 0 
Let e= a/l and write wo/w = ae, where o = wol/wa. Let 8 = k/muwg and change 
the time scale from £ to 7 = wt. In the new time scale, the equation of motion is 


dé do 2,2 . A 
gri + eer. (a €" — ESin T)sinÓ + age? cosrsing — 0 


With 
1d6 
£j, %2=~— + cosrsind 
edr 


as state varjables, the state equation is given by 


d 
p: = ef(r,z) (10.31) 


TTo derive this equation, writ i 
a i e expressions for the z- and y-coordinates of the bob as z = [si 8 
A y = lcosÓ -asinut. Then, show that the velocity and acceleration of the bob in the Guipantfal 
irection are (6 + awcoswtsin@) and (19 — aw? sinwt sin 6), respectively, The friction force is 
assumed to be viscous friction proportional to the velocity of the bob with a friction coefficient k. 
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where 


A(nz) = v2 — sinr; cost 


fa(t,z) = —azs — a? sin T1 + ©2008 2) cos7 — sin r) cos Ticos? r 


The function f(r, z) is 27-periodic in 7. The average system is given by 


dr 
T = Sale) (10.32) 
where 
1 27r 
favi(z) = 2n à A(nz) dr = z$ 
2T 
fave(t) = on : hí(rz)dr = -aðr — a? sing, — isin2r; 


In arriving at these expressions, we have used the fact that the average of cos 7 is 
zero, while the average of cos? 7 is 1/2. Both the original system (10.31) and the 
average system (10.32) have equilibrium points at (rj = 0, z} = 0) and (z, = 
7, z2 = 0), which correspond to the equilibriuin’ positions 0 = 0 and 0 = sz. With a 
fixed suspension point, the equilibrium position 8 = 0 is exponentially stable, while 
the equilibrium position 2 = 7 is unstable, Let us see what a vibrating suspension 
Point will do to the system. To apply Theorem 10.4, we analyze the stability 
properties of the equilibrium points of the average system (10.32) via linearization. 
The Jacobian of fav(2) is given by 


0f, 0 1 


Ox 2 


-a'cosz, —0.5cos2z,; -aß 


At the equilibrium point (x; = 0, £2 = 0). the Jacobian 
0 1 
—e? — 0.5 —afi 


is Hurwitz for all positive values of a and f. Therefore, Theorem 10.4 says that, 
for sufficiently small €, the original system (10.31) has a unique exponentially stable 
2n-periodic solution in an O(e) neighborhood of the origin. Because the origin is 
an equilibrium point for the original system, the Periodic solution is the trivial 
solution z = 0. In this case, Theorem 10.4 confirins that, for sufficiently small 
E, the origin is an exponentially stable equilibrium point for the original system 
(10.31). In other words, exponential stability of the lower equilibrium position of 
the pendulum is preserved under (sinall-amplitude, high-frequency) vibration of the 
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suspension point. At the equilibrium point (xı = 7,22 = 0), the Jacobian 
0 et 
o?—0.5 -aß 


is Hurwitz for 0 < a < 1/V2 and 3 > 0. Noting, again, that si -m, mc 
is an equilibrium point for the original system, and applying bias s 
are led to the conclusion that if a < 1/ V2, then the Posee dnd do 2) 
0 = 7 is an exponentially stable equilibrium point for the origina pa 2 e P 
for sufficiently small e. This is an intriguing finding, because i sk anb 

unstable upper equilibrium position of the pendulum can be Mee ize dh " 
the suspension point vertically with small amplitude and high frequency. 


10.5 Weakly Nonlinear Second-Order Oscillators 
Consider the second-order system | 
jt wy = eg(y, ý) (10.33) 


where g(-,-) is sufficiently smooth and |g] is bounded by kly| or k|g| on compact vin 
of (y. ý); k is a positive constant. Choosing z, = y and z2 = y/w as state variables, 
we obtain the state equation 


ii = wl 


€ 
—wz, 901,23) 


1l 


12 


Representing the system in the polar coordinates 


zy =rsing, £9 -—rcosó 
we havc 
rom acre + 2312) = £ g(r sin ġ, wr cos $) cos ó (10.34) 
T w 
j l (3s; = md * 9(rsi i 10.35 
$ = Gltedi — 2142) = w- -——g(rsinó,urcosó)sinó (10.35) 


The second term on the right-hand side of (10.35) is O(e) on ee m 2r 
as a consequence of the assumption that |g| is bounded by k|y| or k|gj. ; 


8The idea of introducing high-frequency, zero-mean vibrations in the parameters ol : E 
system in order to modify the properties of the system in a desired manner has E 
into a principle of vibrational control. (Scc (22] and [127].) 
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the right-hand side of (10.35) is positive for sufficiently small e. Divide (10.34) by 
(10.35) to obtain . 

dr eg(r sin @, wr cos $) cos ó 

dó = p (e/r)g(r sin à, wr cos Q)sinó 
We rewrite this equation as 
~- = efl rE): (10.36) 
Mere g(r sin $, wr cos à) cos ó 
f(,n,e) = w? — (e[v)g(r sin $, wr cos 4) sin ó 
If we view ¢ as the independent variable, then (10.36) takes the form (10.23), where 
f (d, v, &) is 27-periodic in g. The function fav(r) is given by 


1 2n 1 2T 
fe (r) = mh f(à,r,0) dọ = TA h g(r sin ó, wr cos ¢) cos @ dó 
Suppose the average system F 
T 
— = E fav 10.37 
NO (10.37) 


has an equilibrium point r*, where [Ofav/Or\(r*) < 0; then, there is e* > 0 such 
that Y 0 < € < c*, (10.36) has a unique exponentially stable 27-periodic solution 
r = R(¢,e) in an O(c) neighborhood of r*. This, by itself, does not say that 
(10.33) has a periodic solution with respect to t. More work is needed to reach that 
conclusion. Substituting r = R(¢, £) into (10.35) yields 
à2w- OP Re £) sin ¢, wR(¢, €) cos 9) sin ó 
Let $*(t,€) be the solution of this equation starting at ¢°(0,¢) = 0. To show that 
(10.33) has a periodic solution, we need to show that there exists T =T(e) » 0, 
generally dependent on £, such that 
o*(t+T,e) = 2n - ó* (e), Vt z 0 (10.38) 
For then, - 
R(Q (t + T,e),e) = R(27 + $°(t,€),€) = R(6"(t,e),e) 
which implies that R(¢* (t, €), £) is T-periodic in t. Because 
g(t +r, g) = ¢* (t,£) + wr + Ole) 
for bounded 7 > 0, it can be easily seen that, for sufficiently small e, (10.38) has a 
unique solution T(e) = 27/w + O(e). 

The image of the solution r = R(¢* (t,€),€) in the state plane 1-72 is a closed 
orbit in the neighborhood of the circle r = 7". Since the periodic solution r = Rid, €) 
is exponentially stable, the closed orbit will attract all solutions in its neighborhood; 
that is, the closed orbit is a stable limit cycle. 
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Example 10.11 The Van der Pol equation 


g+y=eg(1-y") 


is a special case of (10.33) with w = 1 and g(y, ý) = (1 — y). The function f(r) 
is given by 


2n 
f(r) = = J (1— r? sin? 9) r cos? ¢ do 


1 2n 1 2n 
= x | rex à dò- y. | r? sin? $ cos? ¢ dd 


z ls 
= uu 
The average system 
dr 
ane (br hr) 


has three equilibrium points at r = 0, r = 2, and r = —2. Since by definition r > 0, 
the negative root is rejected. We check stability of the equilibria via linearization. 
The Jacobian matrix is given by 


dfay 1 3,2 
dr 2 8" 
and 
fav 1 df 
-2$520 | =- 
uuo Vases 


Thus, the equilibrium point r = 2 is exponentially stable. Therefore, for sufficiently 
small e, the Van der Pol equation has a stable limit cycle in an O(e) neighborhood 
of r = 2. The period of oscillation is O(c) close to 27. This stable limit cycle was 
observed in Example 2.6 via simulation. A 


Let us conclude by noting that the foregoing procedure may be used to show the 
existence of an unstable limit cycle. This can be done by reversing time in (10.33) 
that is, replacing t by r = —t. If the system has a stable limit cycle in reverse time, 
it will have an unstable limit cycle in forward time. 


. 10.6 General Averaging 


Consider the system 
z= ef(t,x,e) (10.39) 


where f and its partial derivatives with respect to (x, €) up to the second order are 
continuous and bounded for (t,2,€) € [0,00) x Do x (0, €o], for every compact set 
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Do C D. The parameter e is positive. and D C R" is a domain. The averaging 
method applies to the System (10.39) iu cases 1nore general than the case when 


F(t, , &) is periodic in t. In particular, it applies when the function f(t,z,0 


) hasa 
well-defined average Jav (x) according to the next definition. 


Definition 10.2 A continuous, bounded function g : 0,00) x D — R" is said to 
have an average Gav (x) if the limit 
1 t+T 
onle) = dim = f g(r.x) dr 
exists and 


1 


tT A 
F g(7,2) dr — gs, (x)| < ko(T), V(t,r)€ [0, 2c) x Do 


for every compact set Do C D, where k isa positive constant (possibly dependent on 
Do) and a : (0, o0) — (0, 00) is a strictly decreasing, continuous, bounded function 
such that o(T) — 0 as T — x. The function o is called the convergence function. 


Example 10.12 


* Let g(t,z) = pie g(t, z), where gy (t, i) is periodic in t of period Ty, with 
Ti # T; when i Æ j. The function g is not periodic? in t, but it has the average 


N C 
dav(2) = Y au, (2) 
k=1 


where gi. is the average of the periodic function g(t, z), as defined in Sec- 
tion 10.4. The convergence function c is of order O(1/T) as T — oc. We can 
take it as (T) = 1/(T + 1). 


* The average of 
1 
glt, x) = i2] 0 


is zero, and the convergence function o can be taken as c(T) = (1/ T)hi(14-T). 
A 


Suppose now that f (t. 2.0) has the average function fay(x) with convergence 


function c. Let 


h(t, z) = f(t,z,0) — fav(z) l (10.40) 


This function is called almost periodic. An introduction to the theory of almost periodic 


functions can be found in [59] or [r5]. 
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The function h(t, x) has zero average with o as its convergence function. Suppose 
the Jacobian matrix Qh/Oz has zero average with the same convergence function g. 
Define 


w(t, z,n) = [ h(r, x) exp|-n(t — 7)] dr (10.41) 


for some positive constant 7. At 7 = 0, the function w(t, x, 0) satisfies 


t+ô t 
| h(T, x) dr — f h(r,a) dr 
0 D 


t+ 
J h(7, £) dr 
t 


Ju(t + 6.7.0) — w(t,2,0)]} = | 


This implies. in particular, that 
u(t, 2, 0)|| € kto(t). V (tz) € [0,00) x Do 


since w(0, x. 0) = 0. Integrating the right-hand side of (10.41) bv parts. we obtain 


< kéo(6) (10.42) 


t 
w(tz.) = uzo) -n | exp[-n(t — r)]w(r, z, 0) dr 


exp(—nt)e(t, z,0) — n | exp[-n(t — 7)] [ur 2.0) — w(t, x, 0)] dr 


It 


where the second equality is obtained by adding and subtracting 
rf exp[—1(t — 7)] dr w(t, x, 0) 
0 
to the right-hand side. Using (10.42). we obtain 
helt. rni] € kt exp(—1t)o(t) + mf exp[-n(t — 7))(£ — r)e(t — 7) dr (10.43) 


This inequality can be used to show that nllw(t,z,n) | is Ta EM by 
ko(n) for soine class K function a. For example, if e(t) = 1/(t + 1), then 


t 
nllw(t. 2, )|] € knexp(—7t) + m f exp[—(t — 7)] dr = kn 


|w(f.r.3)] € ka(a). If e(t) = 1/(^ +1) with 


Defining a(n) = 7. we have 7 
0<r< 1. then 


j t 
Ms ~), id -n0(t-7) Ex (1-r) dT 
nhw(tzm) < byt Me tee f ig. 


Oo . 
1-r oo s (1-7) 
LU 0 
Sl r(2-7) r 
1-7 -ü-r n? ck 
Z in( ) e 077 key cn < kk 
Ui 
- P 4 
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where I'(-) denotes the standard gamma function. Defining a(n) = ky", we have 
nlw(t z,n)|| € ka(n). In general, it can be shown (Exercise 10.19) that there is a 


class KC function @ such that 
nljw(t,z,n)l| € ka(n), V (t,x) € [0, 00) x Do (10.44) 


Without loss of generality, we can choose a(n) such that a(n) > cn for 7 € [0, 1], 
where c is a positive constant. The partial derivatives [Qw/Ot] and [@w/Oz] are 


given by 


- Qv 
po^ Mbt) -au(t2,n) 
Ow * Oh 
ðr — ] a; dein - 7) dr. 


Because [0h/Óx|] possesses the same properties of h that have been used to arrive 
at (10.44), it is clear that we can repeat the previous derivations to show that 


Oz \\ ~ 
There is no loss of generality in using the same class K function in both (10.44) and 
(10.45), since the calculated estimates will differ only in the positive constant that 
multiplies the 7 dependent term, so we can define a by using the.larger of the two 
constants. 

`The function w(t, z, 7) that we have just defined possesses all the key properties 
of the function a(t,z) of Section 10.4. The only difference is that the function 
w is parameterized in a parameter 7 in such a way that the bounds on w and 
[Qw/Oz) are of the form ka(n)/n for some class X function a. We did not need to 
parameterize u in terms of any parameter. In fact, u(t, 2) is nothing more than the 
function w(t,z,7) evaluated at n x 0. This should come as no surprise because in 
the periodic case, the convergence function a(t) = 1/(t + 1); hence, a(n)/n = 1. 

From this point on, the analysis will be very similar to that of Section 10.4. We 

define the change of variables 


- | < ka(n), V (t,x) € (0,00) x Do (10.45) 


n 


à 


_z=yteu(t,y,€) (10.46) 


The term ew(t, y, €) is of order O(a(e)); thus, for sufficiently small e, the change of 
variables of (10.46) is well defined, since the matrix [7 + 0w/0y] is nonsingular. In 
particular, : 


8w] | 
h + | = I + O(a(e)) 
Proceeding as in Section 10.4, we can show that the state equation for y is given by 
ý = efav(y) + ea(e)a(t,y,€) (10.47) 
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where g(t, y,€) is bounded on [0,00) x Do for sufliciently small e. In arriving at 
(10.47), we have used the fact that a(e) > ce. Equation (10.47) is a perturbation 


of the average system 
t = efay(z) (10.48) 


It is similar to (10.29), except that the coefficient of the q term is ea(e), instead of £?, 
This observation leads to the following theorem, which is similar to Theorem 10.4, 
except that the estimates O(e) are replaced by the estimates O(a(e)). , 


Theorem 10.5 Let f(t,z,€) and its partial derivatives with respect to (x,€) up 
to the second order be continuous and bounded for (t,z,€) € [0, 00) x Do x [0, €o], 
for every compact set Dy C D, where € > 0 and D C R” is a domain. Suppose 


f(t,2,0) has the average function f.,(z) on [0,00) x D and the Jacobian of h(t, x) = 


f(t, 2,0) — foy(z) has zero average with the same convergence function as f. Let 
z(t,€) and Tay(Et) denote the solutions of (10.39) and (10.48), respectively, and a 
be the class K function appearing in the estimates of (10.44) and (10.45). 


* If z,, (et) E D Vt € [0,b/e] and z(0,€) — z,,(0) = O(o(e)), then there exists 
E” > 0 such that for all 0 < € < £*, x(t,e) is defined and 


x(t,€) — za, (et) = O(a(e)) on [0, b/c] 


e If the origin x = 0 € D is an exponentially stable equilibrium point of the 
average system (10.48), 2 C D is a compact subset of its region of attraction, 
Tav(0) € Q, and z(0,e) — z,,(0,&) = O(a(e)), then there exists e* > 0 such 
that for all 0 < € < €*, a (1, €) is defined and 


z(t,&) — Zay(et) = O(a(e)) for all t € [0, oo) 
e If the origin x = 0 € D is an exponentially stable equilibrium point of the 
average system (10.48) and f(t,0,&) = 0 for all (t,£) € [0,00) x [0, £g], then 


there exists €* > 0 such that for all0 < € < €*, the origin is an exponentially 
stable equilibrium point of the original system (10.39). o 


Proof By expressing (10.47) in the s — et time scale, applying Theorems 3.4 and 


3.5, and using the change of variables of (10.46), we can conclude the first part of 


the theorem. For the second part, we apply Theorem 9.1 on continuity of solutions 
on the infinite interval. Finally, by using h(t, 0) = 0, w(t,0,7) = 0, and the bound 
lw/8z|| S ka(n)/n, we see that the estimate on w can be revised to 


n|lw(t, z,7)|| € ko(n)llzli 


The assumption f (£,0, €) = 0 and differentiability of f with respect to € imply that 
f(t, x, €) is Lipschitz in e, linearly in z; that is, 


f(t, 2, €) = f(t, T, 0)J < Lieliz|l 


WT 


UAM 
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Using these estimates, it can be verified that the function q(t, y, e) in (10.47) satis- 


. fies the inequality ||q(t, y,€)|| € L|[y|| with some positive constant L for (t,y,c) € 
[0, co) x Di x [0, £1], where D;  (|[y|| < r1) and r1 and £, are chosen small enough. . 


By (the converse Lyapunov) Theorem 4.14 and Lemma 9.1, we conclude that, for 
sufficiently small e, the origin is an exponentially stable equilibrium point for the 
original system (10.39). a 


Example 10.13 Consider the linear system 


= eA(t)z 


where € > 0. Suppose A(t) and its derivatives up to the second order are continuous 
and bounded. Moreover, suppose A(t) has an average 


t+T 
Aay = Jim a= ff A(r) dr 


in the sense of Definition 10.2. The average system is given by 
t = €CAgyr 


Suppose A,, is Hurwitz. By Theorem 10.5, we conclude that the origin of the 
original time-varying system is exponentially stable for sufficiently sinall e. Suppose 
further that the matrix A(t) = Atr(t) + Ass(t) is the sum of a transient component 
Aun(t) and a steady-state component A&,(f). The transient component decays to 
zero exponentially fast; that is, 


[| A«(t)] S kı exp(—yt), & > 0, 7 >0 
while the elements of the steady-state component are formed of a finite sum of 


sinusoids with distinct frequencies. The average of the transient component is zero, 
since 


l t+T 1 t+T * k E 
F llAte(7)|| dr < F) kye T dr = Tr [1-e 


k2 
~T+1 


Recalling the first case of Example 10.12, we see that A(t) has an average with 
convergence function o(T) = 1/(T 4-1). Hence, the class K function of Theorem 10.5 
is a(n) = 7. Let z(t,£) and Zay(et) denote solutions of the original and average 
systems, which start from the same initial state. By Theorem 10.5. 


z(t,€) — zav(et) = Ole), Vt20 
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10.7 Exercises 
10.1 If (c) = O(c). is it O(e'/)? Is it O(c/2)? 


10.2 If 6(¢) = ¢!/", where n > 1 is a positive integer, is there a positive integer N 
such that 6(€) = ol” y 


10.3 Consider the initial value problem 


i —-(0.2 + &)zi + 1 —tan^!z,-etan ! zo, zi(0)— 


ig —(0.2+ €)r2+ 2 — tan`! zo etan! zj,. x2(0) — m 
(a) Find an O(s) approximation. 

(b) Find au O(e?) approximation. 

(c) Investigate the validity of the approximation on the infinite interval. 


(d) Calculate. using a computer program, the exact solution, the O(e) approxima- 
tion, and the O(e?) approximation for € = 0.1, m = 0.5, aud 2 = 1.5 on the 
time interval [0,3]. Comment on the accuracy of the approximation. 


Hint: In parts (a) aud (b), it is sufficient to give the equations defining the ap- 
proximation. You are not required to find an analytic closed-Iorin expression for 
the approximation. 


10.4 Repeat Exercise 10.3 for the system ' 
i = T9, ia = ~T] — T2 4 Ex] 
In part (d), let € = 0.1, 7) = 1.0, n2 = 0.0. and the time interval be [0. 5]. 
10.5 Repeat Exercise 10.3 for the systein 
dy = —T) + 2, ig = €i — 12 — 123 
In part (d). let ¢ = 0.2, m = 1.0, 72 = 0.0. and the time interval be o, 4]. 
10.6 ([166]) Repeat Exercise 10.3 for the system 
t =r- z? TET. t2 -—219— r2 — ETIT? 
In part (d), let e 20.2, m = 0.5, 2 = 1.0. and the time interval be [0,4]. 
10.7 Repeat Exercise 10.3 for the system 
gy = -z +aQ(l+21)te(l+21)?, — 42 —-71(11 +1) 


In part (d), let e = —0.1, 71 = —1, and n = 2. Repeat the calculation for € = —0.05 
and e = —0.2 and comment on the accuracy of the approximation. 
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10.8 Consider the initial value problem 


-ri em» m(0)-m 
zo(0) — n 


ii = 
£9 = -127 E21 | 
Find an O(e) approximation. Calculate the exact and approximate solutions p 
c = 0.1 for two different sets of initial conditions: (1) n = 1, (2) n = 10. ae 
on the approximation accuracy. Explain any discrepancy with Theorem 10.1. 


10.9 ([70]) Study, using the averaging method, each of the following scalar sys- 


s. , Wn 
im (1) £—e(z — z2)sin?t (2) &- &(zcos?t — 527) 


(3) & = e(—x + cos? t) (4) $ 2 —ezcost 


| 10.10 For each of the following systems, show that, for sufficiently small € > 0, 


the origin is exponentially stable: 


(1) £1 = ET? 
9 = —e(1 + 2sint)zz — E(1 + cos t)sin zı 


(2) 1 = e[(-1 + 1.5cos? t)zi + (1 — 15sintcos t)za] 
dg = e[(-1 — 1.5sin tcost)zı + (-1 +15 sin? t)z2] 


(3) t =e (-rsin?t +a’ sint+ze™*), 60 


10.11 Consider the system 


i = e[(—1 + 1.5cos? t)x, + (1 — 1.5 sin tcost)za] 


t = e[(-1- L5sintcost)zi +(-1+ 1.5sin? t)x9] + e7* 


Show that there is e* > 0 such that for all 0 < € < é* and all z(0) e R?, c(t) +0 
as t — oo. : 

10.12 Consider the system ý = Ay + e9{t, ye), e > 0, where then x n matrix A 
has only simple eigenvalues on the imaginary axis. 


(a) Show that exp( At) and exp(— At) are bounded for all t 2 0. 
(b) Show that the change of variables y = exp(At)z transforms the system into 
the form + = ef (t, z,£), where f = exp( — At)g(t, exp( At)z, €). 


10.13 ([166]) Study Mathieu's equation jj + (1+ 2e cos 2t)y = 0, € > 0, using the 


averaging method. 
Hint: Use Exercise 10.12. 


E a$ noO ORON i b 
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10.14 ([166]) Study the equation j--y = 8s(j)^ cost using the averaging method. 
Hint: Use Exercise 10.12. 


10.15 Apply the averaging method to study the existence of limit cycles for each 
of the second-order systems that follow. If there is a limit cycle, estimate its location 
in the state plane and the period of oscillation, and determine whether it is stable 
or unstable. 


(1) jy = —ey(1 - y?) 


(2) j*y 290-9?) - e? 
(3) j* y - -e(1- lal) 9 (4) j* y = -e(1— Flyl) 9 
(8) ğ+y = —e(9 - v?) (6) j*y -e0- 9? - 3?) 
10.16 Consider the second-order system 

$j—29, t= -2 +eļzı + 20- a} —2})], e»0 
(a) Show that, for sufficiently small £, the system has a stable limit cycle. 


(b) Show that the system has no periodic orbits when e > 1. 


10.17 Consider Rayleigh's equation 


du i du 2 du 
mig tuma [rc ($) É 


where m, k, À, and a are positive constants. 


(a) Using the dimensionless variables y = u/u*, r = t/t*, and £ = A/A*, where 
(u*)?ak = m/3, t* = /m/k, and À* = V km, show that the equation can be 
normalized to 


jty-e(9- 30°) 
in which y denotes the derivative of y with respect to r. 


(b) Apply the averaging method to show that the normalized Rayleigh equation 
has a stable limit cycle. Estimate the location of the limit cycle in the plane 
(y, 3). 


(c) Using a numerical algorithm, obtain the phase portrait of the normalized 
Rayleigh equation in the plane (y, j) for 


(i)e=1, (ii)e=0.1, and (iii)e — 0.01, 


Compare with the results of part (b). 
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10.18 Consider Duffing's equation 
mj + cj + ky + ka^y? = Acoswt 
where A, a, c, k, m, and v are positive constants. 


(a) Taking zi = y, z2 = y, T = wt, and € = 1/w, show that the equation can be 
represented as dz/dr = ef(r,z,€). 


(b) Show that the system has an exponentially stable periodic solution for suffi- 
ciently large w. Estimate the frequency of oscillation and the location of the 
periodic orbit in the phase plane. 


10.19 Verify (10.44). 
Hint: Start from (10.43) and use the fact that o(t) is bounded for t € 1/ y7, while 


for t > 1/ fj, e(t) < e(1/ m). 
10.20 Study, using general averaging, the scalar system 
t= e (sin? t + sin 1.5t +e7*) x 


10.21 ([168]) The output of an nth-order linear time-invariant single-input-single- 
output system can be represented by y(t) = 6T w(t), where 6 is a (2n--1)-dimensional 
vector of constant parameters and w(t) is an auxiliary signal that can be synthe- 
sized from the system's input and output without knowing 0. Suppose that the 
vector @ is unknown and denote its value by 0*. In identification experiments, the 
parameter (1) is updated by using an adaptation law of the form 0  —ee(t)w(t), 
where e(t) = [0(t) —6*]7 w(t) is the error between the actual system's output and the 
estimated output obtained by using @(t). Let ó(t) = @(¢) — 0" denote the parameter 
error. 


(a) Show that à = eA(t)ó, where A(t) = —w(t)w7 (t). 


. (b) Using (general) averaging, derive a condition on w(t), which ensures that, for 


sufficiently small e, 0(t) — 0" as t — oo. 


Chapter 11 


oingular Perturbations 


While the perturbation method of Section 10.1 applies to state equations that de- 
peud smoothly on a small parameter £, in this chapter we face a more difficult 
perturbation problem characterized by discontinuous dependence of system proper- 
ties on the perturbation parameter e. We will study the so-called standard singular 
perturbation model l 


te 


i = Itz, 
w 


,é) 
ei = g(t, rs ,&) 


tU 


where setting € = 0 causes a fundamental and abrupt change in the dynamic proper- 
ties of the system, as the differential equation 2 = g degenerates into the algebraic 
or transcendental equation 


0 = g(t,x,2.0) ` 


The essence of the theory developed in this chapter is that the discontinuity of 
solutions caused by singular perturbations can be avoided if analyzed in separate 
time scales. This multitime-scale approach is a fundamental characteristic of the 
singular perturbation method. 

In Section 11.1, we define the standard singular perturbation model and illus- 
trate, via examples, some of its physical sources. In Section 11.2, we study the two- 
time-scale properties of the standard model and give a trajectory approximation 
result, based on the decomposition of the. model into reduced (slow) and boundary- 
layer (fast) models. The approximation result is extended in Section 11.3 to the 
infinite-time interval. The intuition behind the time-scale decomposition becomes 
more transparent with a geometric viewpoint. which we present in Section 11.4. 
The time-scale decomposition of Section 11.2 is used in Section 11.5 to analyze the 
stability of equilibrium points via Lyapunov's method. 
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E NASAN S e Saat dard Singular Perturbation Model 
pESSC l 

| The singular perturbation model of a dynamical system is a state model Miss 
4 derivatives of some of the states are multiplied by a small positive parameter £; 

e is, 

< z= f(t,z, 2,€) PER 
S EZ = g(t,2,2,E) (11. ) 
$ We assume that the functions f and g are continuously differentiable in their ar 


FM 
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T 
guments for (t,2,2,6) € [0,5] x Dz x D,x [0, €o], where Dz C eon ied ul 
are open connected sets. When we set £ = 0 in (11.1) and (11.2), the dim e 
the state equation reduces from n +m to n because the differential equation (11. 


degenerates into the equation 


0 = g(t, £, 2,0) (11.3) 


We say that the model (11.1)-(11.2) is in standard form if (11.3) has k 2 1 isolated 


real roots 
z-h(tz) ¢=1,2,...,% (11.4) 
i i that a well-defined n- 
for each (t,£) € [0,5] x Dz- This assumption ensures ! 
dimensional reduced model will correspond to each root of (11.3). To obtain the 
ith reduced model, we substitute (11.4) into (11.1), at € =0, to obtain 


t= f(t, A(t, x), 0) (11.5) 


where we have dropped the subscript i from h. It will be clear from the pra 
which root of (11.3) we are using. This model is sometimes called a pit i 
state model, because z, whose velocity 2 = g/& can be large when e is = Tes 

g #0, may rapidly converge to a root of (11.3), which is the equilibrium n ( 5 là 
We will discuss this two-time-scale pene of A and (11.2) in the next section. 

] (11.5) is also known as the slow mode. 

Tena & d system in the singularly perturbed form may a bs red 
It is not always clear how to pick the parameters to be considered as 7 . Fo is 
nately, in many applications, our knowledge of physical processes an fe i 
of the system sets us on the right track.! The following four examples i ustra = ce) d 
different, "typical" ways of choosing the parameter £. In the first example, eis se 
as a small time constant. This is the most popular source of singularly pertur e 

models and, historically, the case that motivated interest in cer INR 
Small time constants, masses, capacitances, and similar "parasitic parameters t = 
increase the order of a model are quite common in physical systems. In the epe 

of model simplification, we usually neglect these parasitic parameters to reduce the 


Ti TEED mand z à 
1More about modeling physical systems in the singularly perturbed form can be found in [38], 
[105, Chapter 1], and [104, Chapter 4]. 
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order of the model. Singular perturbations legitimize this ad hoc model simplifica- 
tion and provide tools for improving oversimplified models. In the second example, 

the parameter & is the reciprocal of a high-gain parameter in a feedback system. 

The example represents an important source of singularly perturbed models. The 
use of high-gain parameters, or more precisely, parameters that are driven asymp- 

totically toward infinity, in the design of feedback control systems is quite common. 

A typical approach to the analysis and design of high-gain feedback systems is to 
model them in the singularly perturbed form. In the third example, the parameter 
€ is a parasitic resistor in an electric circuit. Although neglecting the parasitic re- 
sistor reduces the order of the model, it does it in a way that is quite distinct from 
neglecting a parasitic time constant. Modeling the system in the standard singu- 
larly perturbed form involves a careful choice of the state variables. In the fourth 
example, the parameter & is the ratio of the natural frequency of the car body to 
the natural frequency of the tire in an automotive suspension model. The special 
feature of this example is that it cannot be modeled in the standard singularly 

perturbed form without ¢-dependent scaling of the state variables. 


Example 11.1 An armature-controlled DC motor can be modeled by the second- 
order state equation . 


E dw f 
fuc 
di T 
La = -kw—-—Rit+u 


where i, u, R, and L are the armature current, voltage, resistance, and inductance, J 
is the moment of inertia, w is the angular speed, and ki and kw are, respectively, the 
torque and the back electromotive force (e.m.f.) developed with constant excitation 
flux. The first state equation is a mechanical torque equation, and the second one 
is an equation for the electric transient in the armature circuit. Typically, L is 
“small” and can play the role of our parameter e. This means that, with w = x and 
| = z, the motor's model is in the standard form of (11.1)-(11.2) whenever R # 0. 
Neglecting L, we solve ; 
0 = -kw— Ri+u 


to obtain (the unique root) 


ix u- kw 
= R 
and substitute it into the torque equation. The resulting model 
. k? k 
Jo =- R" t R“ 


is the commonly used first-order model of the DC motor. As we discussed in Chap- 
ter 10, it is preferable to choose the perturbation parameter & as a dimensionless 


ds 


4 ^ 
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Figure 11.1: Actuator control with high-gain feedback. 


ratio of two physical parameters. To that end, let us define the dimensionless vari- 


ables 
Wr = =; i= iR, u. = u 
q^ ; Up =m 


and rewrite the state equation as 
Im = dr 
wr — ipd Uy 


Mess Tm = JR/ k? is the mechanical time constant and T, = L/R is the electrical 
a constant. Since Tm > Te, we let Tm be the time unit; that is, we introduce 
the dimensionless time variable t, = t/Tm and rewrite the state equation as 


ae 
dt, 
Tm dt, 
This scaling has brought the model into the standard form with a physi 
ingful dimensionless parameter RC Ed 


ir 


= -wr-ip tu, 


ee E 


m JR? 
A 


Example 11.2 Consider the feedback control system of Figure 11.1. The inner 
loop represents actuator control with high-gain feedback. The high-gain parameter 
is the integrator constant kı. The plant is a single-input-single-output nth-order 
a represented by the state model {A,B,C}. The nonlinearity (-) € (0, co]; 
that. is, 


e(d) = 0 and yé(y) > 0. V y #0 
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Figure 11.2: Simplified block diagram of Figure 11.1. 


The state equation for the closed-loop system is 
£j = Ary Bu, 


1, 

ge ~” v(u — up — ksC zy) 

With £ = 1/ki, zp = T, and uy = 2, the model takes the form of (11.1)-(11.2). 
Setting € = 0, or equivalently kı = o, we solve 


vV(u — Up — k2Czp) = 0 


to obtain 
Up = u- koCzp 
which is the unique root since #(-) vanishes only at its origin. The resulting reduced 
model 
ip = (A — BkaC)r, + Bu 


agrain of Figure 11.2, where the whole inner 


is the model of the simplified block di 
A 


loop in Figure 11.1 is replaced by a direct connection. 


Example 11.3 Consider again the electric circuit of Example 10.4, shown in Fig- 


ure 10.2. The differential equations for the voltages across the capacitors are 
Kl 
Ch = 4(E-u)-»(w)- gi — v2) 
c 


Cig = 


mul - dy] 


(E — v2) — Y(v2) — gm —v) 


In Example 10.4, we analyzed the circuit for a “large” resistor Re, which was ide- 
alized to be open circuit when 1 / R, was set to zero. This time, let us study the 
circuit for a "small" Re. Setting Re = 0 replaces the resistor with a short-circuit 
connection that. puts the two capacitors in parallel. In a well-defined model for this 
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simplified circuit, the two capacitors in parallel should be replaced by one equivalent : 
capacitor, which means that the model of the simplified circuit will be of order c 
To represent the model order reduction as a singular perturbation, let us start with : 
the seeming choice £ = Re and rewrite the state equation as Ses 


1 

eh = qg(E-u)-249(0)- (n - v) 
i 1 

ej = mgE-€)-(4(0)- g-a) 


If the preceding model were in the form of (11.1)-(11.2), both v, and v2 would be 
considered as z variables, and (11.3) would be 
v — v9 —0 


However, the roots of this equation are not isolated, which violates the basic as- 
sumption that the roots of (11.3) should be isolated. Therefore, with vı and v2 as 
z variables, the model is not in the standard form. Let us now try another choice 
of the state variables. Take? : 


r=} (vu +v); z= 3(v1— 2) 


The state equation for the new variables is 


i= ag (E - 9 - gola +2) + vle- 2) 
a= - (dae): ipte n-9- al 


Now the unique root of (11.3) is z = 0, which results in the reduced model 
1 1 
ca =a) c» 


This model represents the simplified circuit of Figure 11.3, where each pair of similar 
parallel branches is replaced by an equivalent single branch. To obtain € as a 
dimensionless parameter, we normalize z, z, and # as 

Ir= 5i A 


z s de) FWE) 


and normalize the time variable as t, = t/CR to obtain the singularly perturbed 
model 


i=- 


T 


d 1 j 
zr = l-z,- s [Ur (zr + Zr) + tr (zy Ei E 
dt, 2 
d E 
eE = -let 2z — Ellar +z) — Vole — ze) 
3 
where £ = Re/R is dimensionless. A 


2This choice of state variables follows from a systematic procedure described in [38]. 
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` scaling, we normalize all variables to be dimensionless. Distances are divided by 


wits 
e + 


2C — 24v) 


Figure 11.3: Simplified circuit when R, = 0. 


Example 11.4 A quarter-car model of automotive suspension is shown in Fig- : 
ure 11.4, where m, and m, are the car body and tire masses, k, and k, are the i 
spring constants of the strut and tire, b, is the damper (shock absorber) constant, 
and F is a force generated by a force actuator that may be used in active and semi- 
active suspension. When F = 0, we have the traditional passive suspension. The 
distances ds, du, and d, are the elevations of the car, tire, and road surface, respec- E 
tively, from a reference point. From Newton's law, the balance of forces acting on : 
ms and m, results in the equations 


Mod, + b, (d, — du) + k(d, — du) = F 


Mudu + b, (d, — dy) + k (dy — d,) + keldu — dr) = -F 


In a typical car, the natural frequency V ku/m, of the tire is about 10 times the 
natural frequency 4/k,/m, of the car body and strut. We therefore define the 


parameter 
pe k,/m, [kamu 
B ku Mu B kim, 


This mass-spring system is of interest because it cannot be transformed into 
standard singularly perturbed model without an e-dependent scaling. The tire “ 
stiffness ką = O(1/e*) tends to infinity as € — 0. For the tire potential energy 
k,(d, — d,)?/2 to remain bounded, the displacement d, — d, must be O(c); that 
is, the scaled displacement (d, — d,)/e must remain finite. In addition to this 


some distance £, velocities by £4/ k, / ms, forces by £k,, and time by ,/m,/k,. Thus, 
to express the system in the standard singularly perturbed form, we introduce the 
slow and fast variables as 


(d, — dy)/é 


(d,/0) ms/k; 


(d, — d.)/(e£) 


(du/2) V m;/k, 
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and take u = F/(k,£) as the control input, w = (d,./£) /m;/k, as the disturbance 


input, and t, = t k,/m, as the dismensionless time. The resulting singularly 
perturbed model is 


= 192—229 


d. "o cn-Én-atu 
E- = 2-wW 


ET“ = ad, — af(z2-22)- 71 —ou 


ans [sms ja b, 
km, sMs 
For typical cars with passive suspension, the parameters a, P, and ¢ take values in 
the ranges [0.6, 1.2], [0.5, 0.8], and [0.08,0.135], respectively. In active/semiactive 


suspension, the damping constant may be reduced as the force actuator provides 
additional damping. Setting € = 0 results in the reduced model 


dz, 
di, 
dro 
dt, 


where 


= Z9-—W 


T; —f(r)— w) +u 


which corresponds to the simplified one-degree-of-freedom model shown in Fig- 
ure 11.4. A 


væ 


11.2 Time-Scale Properties of the Standard Model 


Singular perturbations cause a multitime-scale behavior of dynamical systems char- 
acterized by the presence of slow and fast transients in the system's response to 
externa] stimuli. Loosely speaking, the slow response is approximated by the re- 
duced model (11.5), while the discrepancy between the response of the reduced 
model and that of the full model (11.1)-(11.2) is the fast transient. To see this 
point, let us consider the problem of solving the state equation 


i = f(t2,2,€), z(to) = E(e) (11.6) 
Eż g(t,2,2,€),  z(to) = n(e) (11.7) 


where £(c) and 7(¢) depend smoothly on € and to € [0, t1). Let z(t,€) and z(t,€) 
denote the somtion of the [ull problem of (11.6) and (11.7). When we define the 
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Simplified Model 


Quarter-Car Model 
Car Body 


Road Surface 


Refereuce 


Figure 11.4: Quarter-Car Model of Automotive suspension. 


corresponding problem for the reduced model (11.5), we can only specity n initial 
conditions, since the model is nth order. Naturally, we retain the initial state for x 
to obtain the reduced problem 


t= f(t,z,h(t,z),0). z(to)- £o ae €(0) — (1.8) 


Denote the solution of (11.8) by z(t). Because the variable z has been excluded 
froin the reduced model and substituted by its “quasi-steady-state h(t,z), the 


only information we can obtain about z by solving (11.8) is to compute 


=(t) S h(t, ze) 


steady-state behavior of z when z = Z. By contrast to 
à rescribed n(£), the quasi-steady-state 
and there may be a large discrepancy 
the prescribed initial state n(e). Thus, 
The best we can expect is that 


which describes the quasi- 
the original variable z starting at tg from a p 
= is not free to start froin a prescribed value. 
between its initial value Z(to) = A(to. £o) and 
z(t) cannot be a uniform approximation of z(t,e). 
the estimate 

z(t,¢) — Z(t) = Ole) 
will hold on an interval excluding to. that is. for t € fte, 
other hand, it is reasonable to expect tlie estimate 


'a(t,e) - E(t) = O(e) 


ti], where ty > to- On the 


to hold uniformly for all t € [to. t1]; since 
r(to,€) — F(to) = (£) — &(0) = Of) 


If the error z(t, £) — Z(t) is indeed Ole) over fta, t], then it must be p thet pue 
the initial (“boundary-layer”) interval |tu. fa]. the variable z approaches =. Let us 


ne 
` 
c 
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remember that the speed of z can be high, because 2 = g/e. In fact, having set T =0 

in (11.2), we have made the transient of z instantaneous whenever : Æ y an 

our previous study of the stability of equilibrium points, it should ec putem 

we cannot expect z to converge to its quasi-steady-state Z, unless certain S à ility 

conditions are satisfied. Such conditions will result from the forthcoming analysis. 
‘It is more convenient in the analysis to perform the change of variables 


iy—z-h(iz) (11.9) 


that shifts the quasi-steady-state of z to the origin. In the new variables (z, y), the 
full problem is 


$ = f(hzy-ch(tz)&) 2(to) = &(s) (11.10) 
Oh : 
ey = g(t,z, y + h(t,z),€) - ex 


= c2 f(t ay +h(t,z),€), y(to) =7(€) — h(to,£(e)) (11.11) 


i i = 0, which when substituted into (11.10) 
The quasi-steady-state of (11.11) is now y = 0, w l 
results in the reduced model (11.8). To analyze (11.11), let us note that ey may 
remain finite even when € tends to zero and ġ tends to infinity. We set 


dy dr 1 
ea ir hence, oe 
initi = i iablé r = (t — to)/e 
and use 7 = 0 as the initial value at t = tp. The new time varia 
is "stretched"; that is, if € tends to zero, T tends to infinity even for finite t only 
slightly larger than to by a fixed (independent of £) difference. In the T time scale, 
(11.11) is represented by 
dy Oh 


dr = g(t, 2,y + h(t, 2), E) - e; 


` = eS ity zy +h(t,z),e), y(0) =n(e) — h(to,€(e)) (11.12) 
z 
The variables t and z in the foregoing equation will be slowly varying since, in the 
T time scale, they are given by i 
—9 d-igter, z= zlto +eEr7,€) 
‘Setting € = 0 freezes these variables at.t:= tg and x = £o; and reduces (11.12) to 


the autonomous system 


El = 9(to, £o, + h(to, £o), 0), y(0) = n(0) — h(to, £o) È mo — h(to,£) (11.13) 
m 


which has equilibrium at y — 0. If this equilibrium point is asymptotically stable and 
y(0) belongs to its region of attraction, it is reasonable to expect that the solution 
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of (11.13) will reach an O(e) neighborhood of the origin during the boundary-layer 
interval. Beyond this interval, we need a stability property that guarantees that 
y(T) will remain close to zero, while the slowly varying parameters (t, z) move away 
from their initial values (to,£0). To analyze this situation, we allow the frozen 
parameters to take values in the region of the slowly varying parameters (t,2).8 
Assume that the solution Z(t) of the reduced problem is defined for ¢ € [0, t)] and 
Z(t) € D, C R”, for some domain D,. We rewrite (11.13) as 4 

oY = o(t,2,y+h(t,2),0) - (11.14) 
where (t,x) € [0,t1] x D, are treated as fixed parameters. We will refer to (11.14) as 
the boundary-layer model or boundary-layer system: Sometimes, we will also refer 
to (11.13) as the boundary-layer model. This should cause no confusion, because ' 
(11.13) is an evaluation of (11.14) for a given initial time and initial state. The 
crucial stability property we need for (11.14) is exponential Stability of its origin, 
uniformly in the frozen parameters, as stated in the next definition. 


Definition 11.1 -The equilibrium point y = 0 of the boundary-layer system (11.14) 
is exponentially stable, uniformly in (52) € [0,t]] x Dz, if there exist positive 
constants k, ^y, and po such that the solutions of (11.14) ‘satisfy 


llv(7)l < klly(0)|| exp(—vr), V Ily(O) < po, Y (4,2) € 0,5]x Da, Yr > 0 (11.18) 


Aside from trivial cases where the solution of the boundary layer model may be ^ 
known in closed MUR wees of iver stability of the origin will have to — 


be done. either by line: ization or vid Lyapunov analysis. It can be shown (Exer- 
cise 11.5) that if the Jacobian matrix [8g/Oy) satisfies the eigenvalue condition 


o) Re RECA 2}0)}] imd 0, V (52) € [0,t1] x D. (11.16) ` 


then there exist constants k, y, and Po for which (11.15) is satisfied. This, of course, 
is a local result; that is, the constant Po could bé very small. Alternatively, it can be 
shown (Exercise 11.6) that if there is a Lyapunov function Vit, x,y) that satisfies 


p) alvi s V(5z;y) sell? (11.17) 


Fat z, y +h(t,2),0) < esll (11.18) 


for (t,x, y) € [0, ti] x Dz x Dy, where Dy, C R™ is a domain that contains the origin, 
then (11.15) is satisfied with the estimates AB 


£o = pV c1/c2, k = | eae, oy = c5/2e sc (11.19) 


in which B, c D,. 


E METERS 

JRecall from Section 9.6 that if the origin of (11.13) is exponentially stable, uniformly ín the 
frozen parameters (o, £o), then it will remain exponentially stable when these parameters are 
replaced by the slowly varying variables (t, 2). 
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4 
TL KBONOV S. Theor 
Theorem 11.1 Consider the singular perturbation problem of (11.6) and (11.7) 


and let z = h(t, x) be an isolated root of (11.3 j iti 
moans a of (11.3). Assume that the following conditions 


[t z, z — h(t, x), e] € [0, t] x Dz x Dy x (0, €o] 
or some d i i 1 } 
A a: M RS D; C R” and D, C R™, in which D, is convex and D, contains 
e The functions f ; 9, their first partial derivatives with respect to (z,z,€), and 
the first partial derivative of g with respect to t are continuous; the function 
h(t, x) and the Jacobian |Og(t, x, z, 0)/0z] have continuous first partial deriva- 


tives with respect to their arguments; the initial data (€) and 
petites l Ele) and n(e) are smooth 


e The reduced problem (11.8) has a unique solution Z(t) € S, for t € [toti] 
where S is a compact subset of Dz. xd 


e The origin is an exponentially stable equilibri i 
n exp quilibrium point of the boundary-layer 
model (11.14), uniformly in (t,x); let Ry C Dy be the region of attraction of 
(11.13) and Q, be a compact subset of Ry. ' 
Then, there exists a positive constant e* such that for all yo — h(tg, £o) € Qy and 


0 < e < e', the singular perturbation problem of (11.6) and (1 i 
i . 1.7) has 
solution z(t,&), z(t,&) on [to, ti], and (11.7) a unique 


| a(t,e) - x(t) = O(e) (11.20) 
z(t,€) — A(t, Z(t) — g(t/e) = Ofe) (11.21) 
hold uniformly for t € [to, ti], where (T) is the soltition of the boundary-layer model 
(11.13). Moreover, given any ty > to, there is &** < &* such that 

offs) ARDY Of). Tov (11.22) 
holds uniformly for t € [ty,t1] whenever e < e**. o 


Proof: See Appendix C.17. 


This theorem is known asjTikhonov's theorem.‘ \ Its proof uses the stability 
properties of the boundary-layer model to show tha l 


u(t e)l] < ki exp [56-9 Ve 


ate preceding bound is used in (11.10) to prove (11.20), which is plausible, since 
So exp(—as/e) ds is O(c). The proof ends with error analysis of (11.11) in the 7. 
time scale to prove (11.21) and (11.22). i 


4 . * H 
T! here are other versions of Tikhonov's theorem which use slightly different technical assump- 
ona. (See, for example, [105, Chapter 1, Theorem 3.1].) 


11.2. TIME-SCALE PROPERTIES 


Example 11.5 Consider the singular perturbation problem 
I = 2, z(0) £o 


Ul 


ez = -zr-z-cu(t 2(0) Tlo 


for the DC motor of Example 11.1. Suppose u(t) = t for t 2 0 and we want 
to solve the state equation over the iuterval [0,1]. The unique root of (11.3) is 
h(t,z) = -z + t and the boundary-layer model (11.14) is 
dy _ 
dr 
Clearly. the origin of the boundary-layer system is globally exponentially stable. 
The reduced problem 


=y 


z=-x+t, 2(0)=& 
has the unique solution 
z(t) =t- 1 (1+) exp(-t) 
The boundary-layer problem 


-+ = =y, y(0) = mo +60 


has the unique solution 
§(7) = (no + &) exp(-7) 


From Theorem 11.1, we have 


z— [t — 1+ (1+ £o) exp(—t)] = O(€) 


ja | +o) exp (2) £1-(-&)eso(-0| = 0) 


for all t € [0,1]. The O(e) approximation of z clearly exhibits a two-time-scale 
behavior. It starts with a fast transient (ro + £o) exp(—t/e), which is the so-called 
boundary-layer part of the solution. After the decay of this transient, z remains close 
to [1 - (1 + ĉo) exp(—t)], which is the slow (quasi-steady-state) part of the solution. 
The two-time-scale behavior is significant only in z, while z is predominantly slow. 
In fact, x has a fast (boundary-layer) transient, but it is O(e). Since this system is 
linear, we can characterize its two-time-scale behavior via modal analysis. It can be 
easily seen that the system has one slow eigenvalue Ai, which is O(e) close to the 
eigenvalue of the reduced model, that is, A, = —1 + O(c), and one fast eigenvalue 
do = A/e, where A is O(e) close to the eigenvalue of the boundary-layer model, that 
is, Àz = [-1 + O(c)]/e. The exact solutions of z and z will be linear combinations 
of the slow mode exp(A:t), the fast mode exp(At/e), and a steady-state component 
due to the input u(t) = t. By actually calculating the modal decomposition, it can 
be verified that the coefficient of the fast mode in = is O(e). This can be done for 
linear systems in general. (Sec Exercise 11.14.) A 


-— 


X 


it 
1 


c 
< 
- 
© 
V 
v 
e 
w 
we 
k: 
- 
v 
w 
- 
w 
w 
E" 
w 
w 
b 
x 


Ü 


E 
& 


NS NE 


4 


E 
— 


BLP 


dcm 


ADU 


SA BO A BBP 


E: 


7 Uy 


7 : t : - P 
Ex : Pr m ome A 


436 CHAPTER 11. SINGULAR PERTURBATION: 


Example 11.6 Consider the singular perturbation problem 
£o = Ar+Bz, ` z(0) = & 
eż = W(u(t)—z—k2Cz), z(0) = m 


for the high-gain feedback system of Example 11.2. Suppose u(t) = 1 for t 2 0 
and 1(-) = tan71(-). The unique root of (11.3) is h(t,z) = 1 — k2Cx and the 
boundary-layer model (11.14) is 


AY = tan"! (=y) = tn^?) 
The Jacobian 

| -| =i 

Oy y=0 1+ y? y=0 


is Hurwitz; hence, the origin of the boundary-layer model is exponentially stable. 
It is also clear that the origin is globally asymptotically stable. Since the reduced 


problem : 
$-(A-BhC)r B, z(0)—& 


is linear, it is clear that all the assumptions of Theorem 11.1 are satisfied, and we 
can proceed to approximate x and z in terms of the solutions of the. reduced and 


boundary-layer problems. 
Example 11.7 Consider the singular perturbation problem — 


z?(1- t)/z, z(0) 


| 
- 


i 


[| 


eè = -bxü-tzziz-Q0-t) (0) No 


Equation (11.3), which takes the form 
= [2+ a] z z- (1--£)] 
has three isolated roots 
zg=—(1+it)z, 2-0, and z=1+t 
in the region {t > 0 and z > k}, where 0 « k « 1. Consider first the root 


z = —(1 + t)z. The boundary-layer model (11.14) is 


» 


Y yy- (1+ tally - 1:02 - 10] 


A sketch of the right-hand side function, Figure 11.5(a), shows that the origin is 
asymptotically stable with y « (1--t)z as its region of attraction. Taking V (y) = 4°, 
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(b) 


Figure 11.5: RHS of boundary-layer model: (a) z = —(1 + t)z, (b) z = 0. 


it can be easily verified that V satisfies (11.17) and (11.18) for y € p < (1-7 t)z. 
The reduced problem 
P--—z, z(0-1 


has the unique solution Z(t) = exp(—t) for all t > 0. The boundary-layer problem 
with t = 0 and z — 1, 


. 9 --ve- 9-2, v0) o m1 


has a unique decaying solution (7) for no < 0. Consider next the root z = 0. The 


` boundary-layer model (11.14) is 


ty + (1+ i)a] y [v - (19 t)] 


A sketch of the right-hand side function, Figure 11.5(b), shows that the origin is 
unstable. Consequently, Theorem 11.1 does not apply to this case. Finally, the 
boundary-layer model for the root z = 1 + t is 

dy : 

j^ Wt +e) + (1+ tally + (1+ tly 
Similar to the first case, it can be shown that the origin is exponentially stable 
uniformly in (t, z). The reduced problem i 


£-z5, 2(0)=1 


hes the unique solution z(t) = 1/(1 — t) for all t € [0, 1). Notice that Z(t) has a 
finite escape time at t = 1. However, Theorem 11.1 still holds for t € [0, £1] with 
tı < 1. The boundary-layer problem with t = 0 and z — 1, 


a =~(y+2)(y+ ly, y(0) =n -1 


| 
f 
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Figure 11.6: Simulation results for z of Example 11.7 at € = 0.1: reduced solution 
(dashed); exact solution (solid). 
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aoi 11.7; Exact (solid) and approximate (dashed) solutions for Example 11.7 at 
€ — Q.1. 


has a unique decaying solution j(r) for No > 0. Among the three roots of (11.3), 
only two roots, h = —(1-- t)z and h — 1-- t, give rise to valid reduced models. 
Theorem 11.1 applies to the root h = —(1-t)z if no < 0 and to the root h = 1--t if 
fjo > 0. Figures 11.6 and 11.7 show simulation results at € = 0.1. Figure 11.6 shows 
z for four different values of zo, two for each reduced model. Figure 11.7 shows 
the exact and approximate solutions of z and z for m = —0.3. The trajectories 
of Figure 11.6 clearly exhibit a two-time-scale behavior. They start with a fast 
transient of z(¢,¢) from 7 to z(t). After the decay of this transient, they remain 
close to z(t). In the case rg = —0.3, the convergence to 2(t) does not take place 
within the time interval [0,0.2]. The same case is shown in Figure 11.7 on à longer 
time interval, where we can see z(t,¢) approaching z(t). Figure 11.7 illustrates the 
O(s) asymptotic approximation result of Tiklionov's theorem. A 
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11.3 Singular Perturbation on the Infinite Interval 


Theorem 11.1 is valid only on O(1) time intervals. This fact can be easily seen from 
the proof of the theorem. In particular, it is established in (C.81) that 


lz(t, e) — £(t)|| < eks[1 + t — to] exp[Le(t — to)] 


For any finite tj, the foregoing estimate is O(c), but it is not O(e) uniformly in £ 
for all t > tg. For the latter statement to hold, we need to show that 


z(t) - z()]] < ek, V t€ [to oo) 


This can be done under some additional stability conditions. In the next theorem, 
we require the reduced system (11.5) to have an exponentially stable equilibrium 
point at the origin and use a Lyapunov function to estimate its region of attraction. 


| Theorem 11.2 Consider the singular perturbation problem of (11.6) and (11.7) 
'  andletz=ħ(t,z 


) be an isolated root of (11.3). Assume that the following conditions 
are satisfied for all 


[t z, z — h(t, x), e] € [0, 20) x Dz x Dy x [0, eo] 
for some domains D, C R” and D, C R™, which contain their respective origins: 


e On any compact subset of D; xD, the functions f, g, their first partial deriva- 
tives with respect to (z, z, €). and the first partial derivative of g with respect to 

t are continuous and bounded, B(t 2) and [Og(t, z, z, 0)/0] aia is 
artial derivatives with respect to their arguments, and [Of (t, z, h(t, z), 0)/0x 
eer Te Ts the rete ata Ele) and nle) are smooth 


functions oft; 


e the origin is an exponentially stable equilibrium point of the reduced system 
(11.5); there is a Lyapunov function V(t,z) that satisfies the conditions of 
Theorem 4.9 for (11.5) for (t,x) € [0, o0) x Dz and (Wi(z) < c) is a compact 
subset of Dz; 


e the origin is an exponentially stable equilibrium point of the boundary-layer 
system (11.14), uniformly in (t,x); let Ry C Dy be the region of attraction of 
(11.13). and €), be a compact subset of Ry. 


Then, for each compact set Ne C (Wa2(z) € pe, 0 < p < 1} there is a positive 
constant &*. such that for all tg > 0, £y € Ne, Mo — h(to,&o) € Ny, and 0 « € « e', 
the singular perturbation problem of (11.6) and (11.7) has a unique solution z(t, &), 
2(t,€) on [to, oo), and 

(11.23) 


(11.24) 


z(t, £) — z(t) = O(e) 
z(t,&) — h(t. z(t)) — 9(t/e) = Ole) 
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` holds uniformly for t € [tp,00) whenever e < &'*. 
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hold uniformly for t € [to, 00), where Z(t) and (T) are the solutions of the reduced 
and boundary-layer problems (11.8) and (11.13). Moreover, given any ty > to, there 
is e** <e*-such that . . : 

di -z(t e) — h(t, (t)) = O(e) (11.25) 
o 


Proof: See Appendix C.18. 


If the reduced system (11.5) is autonomous, the set Q; in Theorem 11.2 can be 
any compact subset of its region of attraction. This is a consequence of (the con- 
verse Lyapunov) Theorem 4.17, which provides a Lyapunov function V (z) such that 
any compact subset of the region of attraction is in the interior of a compact set of 
the form (V(z) € c). 


Example 11.8 Consider the singular perturbation problem 
1 . 
è = 1-2-hWlet2+¥e-2)), s(0)- 6 
eż = -e+ 2z- Elle +z) - (o7 2). 2(0) = m 


for the electric circuit of Example 11.3, and assume that - 
v 


Y) = a [exp (7) - 1]; a>0,b>0 


We have dropped the subscript r as we copied these equations froni Example 11.3. 
The differentiability and Lipschitz conditions of Theorem 11.2 are satisfied on any 
compact set of (x, z). The reduced model 


£-1-2-a|e (F) - 1| def p (a) 


has a unique equilibrium point at z = p*, where p* is the unique root of fo(p*) = 0. 
It can be easily seen that 0 « p* S The Jacobian 


dfo SA a p' 
Ta --1- Se ( « -1 


r-p* 
is negative; hence, the equilibrium point z — p* is exponentially stable. Moreover, 
by sketching the function fo (x), it can be seen that z = p* is globally asymptotically 
stable. The change of variables = z — p* shifts the equilibrium point to the origin. 
The boundary-layer model 


is independent of z, and its origin is globally exponentially stable. Thus, all the con- 
ditions of Theorem 11.2 are satisfied globally and the estimates of (11.23) through 


(11.25), with h = 0, hold for all t > 0 and for any bounded initial state (£o, 70). 
A 
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Example 11.9 Consider the adaptive control of a plant represented by the second- 
order transfer function 

kp. 
(s — ap)(es + 1) 


where ap, kp > 0, and £ > 0 are unknown parameters. The parameter € represents 
a small "parasitic" time constant. Suppose we have neglected £ and simplified the 
transfer function to x 


P(s) - 


P(s) = —® 


$—05 


We may now proceed to design the adaptive controller for this first-order transfer 
function. In Section 1.2.6, a model reference adaptive controller is given by 


u 017 + bop 

b = -(%p— yn)r 

G2 = —Y(Yp — Ym)¥p 
where yp, U, T, and Ym are the plant output, the control input, the reference input, 
and the reference model output, respectively. With (the first-order model of) the 
plant and the.reference model represented by 


Up = a5yp + ku 
and 
' Úm =Amtm + kmr, km > 0 

it is shown in Section 1.2.6 that the. closed-loop adaptive control system is repre- 
sented by the third-order state equation 

ĉo = Ameot kp¢ur + kpóa (eo + Ym) 

$i = -yer 

$2 = -"ec(eo + Ym) 


rdi: = p — Ym: $1 = 01 — 01, $2 = 05 — 62, OF = km /kp, and 6; = (Am —a5)/ ks. 


z-[e; à ó]" 
as the state vector and rewrite the state equation as 
i= fi o(t, z) 


where fo(t,0) = 0. We will refer to this third-order state equation as the ‘spinal 
adaptive control system, which is the model we use in the stability analysis. We 
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assume that the origin of the model is exponentially stable. When the 
controller is applied to the actual system, the closed- 
from this nominal model. Let us represent the situati 
problem. The actual second-order model of the pla 
singularly perturbed model 


adaptive 
loop system will be different 
on as a singular perturbation 
nt can be represented by the 


jp = pp +kpz 
ef = =z+y 


By repeating the derivations of Section 1.2.6, it can be seen that the actual adaptive 
control system is represented by the singularly perturbed model 


$ = fo(tz)t K[z— h(t, z)] 
Eż = -z+Alt, z) 


where 


h(t,z)-u- (OF + éi)r(t) + (62 + é3)(es + Ym(t)), K = [kp,0, 0|" 


The signal y,,(t) is the output of a Hurwitz transfer function driven by r(t). Therc- 
fore, it has the same smoothness and boundedness properties of r(t). In particular, 
if r(t) has continuous and bounded derivatives up to order N, the same will be 


true for y, (t). Let us analyze this singularly perturbed system, At € = 0, we have 
z = A(t, x) and the reduced model is 


i= folt, z) 


which is the closed-loop model of the nominal adaptive control system. We have 


assumed that the origin of the model is exponentially stable. The boundary-la 
model 
dy 


r5 
is independent of (t, z) and its origin is globally exponentially stable. If the reference 
input r(t) and its derivative *(t) are bounded, all the assumptions of Theorem 11.2 
will be satisfied on any compact set of (z, z). Let = denote the solution of the nom- 
inal adaptive control system and z(t, «) denote the solution of the actual adaptive 


yer 


51t is shown in Example 8.12 that this will be the case un 
dition, In particular, the origin will be exponential! 
at this point: Note that our analysis in this exam 
asymptotic behavior of the system for small e. As we fix the value of € at some small numerical 
value, our underlying assumption puts a constraint on r(t)~in particular, on the input frequency w. 
If we start to increase w, we may reach a point where the conclusions of the example are no longer 
valid because a high-frequency input may violate the slowly varying nature of the slow variable z. 


For example, the signal F(t), which is of order O(w), may violate our assumption that 7 is of order 
O(1) with respect to s, 


der a persistence of excitation Con- 
y stable if r(t) = asinwt. A word of caution 
ple assumes that r(t) is fixed and studies the 
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control system, both starting from the same initial state. Dy Theorem 11.2, we 
conclude that there exists «* > 0 such that for all 0 < € < €", s 


z(t,e) - z(1) = O(e) 


where O(e) holds uniformly in ¢ for all t2 to. This result shows robustness A 
unmodeled fast dynamics. 


11.4 Slow and Fast Manifolds Æ> ciclos Liike, Fotos. " 


In this section, we give a geometric view of the two-time-scale peared of pare 
lutions of (11.1)-(11.2) as trajectories in R"+™. In order to use the ee 
invariant manifolds,9 we restrict our discussion to autonomous systems. E in : 
more, to simplify the notation, we take f and g to be independent of 5 f r 5 
consider the following simpler form of the singularly perturbed system (11.1)-(11.2): 


# = f(e) Dian 
` g(z,z) (11.27) 


Let z = A(z) be an isolated root of 0 = g(z,z) and suppose the pon es of 
Theorem 11.1 are satisfied for this root. The equation z = h(x) descri 2 an n- 
dimensional manifold in the (n + m)-dimensional state space of (z,z). It is an 
invariant manifold for the system 


Eż 


= f(z,z) i (11.28) 
g(z, z) (11.29) 


j in the manifold z = h(z) will remain 
ince a trajectory of (11.28)-(11.29) that starts in t anif : 
in the manifold for all future time (for which the solution is defined). The motion 
in this manifold is described by tlie reduced model 


t= f(z, h(z)) 


Theorem 11.1 shows that trajectories of (11.26)-(11.27), which ys 5 ani ue 
neighborhood of z = h(z), will remain within an O(e) neighborhoo E - sio 
This motivates the following question: Is there an analog of the cim ma; a 
z = h(x) for € > 0? It turns out that, under the assumptions of T viia 2 
there is a nearby invariant manifold for (11.26)-(11.27) that is ES e) 
neighborhood of z = h(x). We seek the invariant manifold for (11.26)-(11. 


the form 


T 
0 


EIE (11.30) 


where H is a sufficiently smooth (that is, sufficiently many times pier a ae 
ferentiable) function of z and e. The expression (11.30) defines an n-dimens 


SInvariant manifolds have been introduced in Section 8.1. 
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manifold, dependent on £, in the (n + m)-dimensional state space of (z,z). For 
z = H(x,&) to be an invariant manifold of (11.26)-(11.27), it must be true that 


2(0,¢) - H(z(0,e),) = 0 = z(t,e) - H(x(t,e),e) 80, VteJc (0, o0) 


where J is any time interval over which the solution [x(t,€), 2(t,€)] exists. Dif- 
ferentiating both sides of (11.30) with respect to.t, multiplying through by €, and 
substituting for 2, eż, and z from (11.26), (11.27), and (11.30), respectively, we 


obtain the manifold condition 


0H 
0 = g(z, H(z,&)) - es f (2: Hie) (11.31) 
which H(z,e) must satisfy for all z in the region of interest and all £ € [0, €o]. At 
€ = 0, the partial differential equation (11.31) degenerates into l 


0 = g(x, H(z,0)) 


which shows that H(z,0) = A(z). Since 0 = g(z,z) may have more than one 
isolated root z = h(x), we may seek an invariant manifold for (11.26)-(11.27) in the 
neighborhood of each root. It can be shown’ that there exist e* > 0 and a function 
H(z, €) satisfying the manifold condition (11.31) for all e € [0,e*] and 


H(z,€) — h(x) = O(c) 


for bounded z. The invariant manifold z = H(z,&) is called a slow manifold for 
(11.26)-(11.27). For each slow manifold, there corresponds a slow model 


ż = f(z, H(2,e)) (11.32) 


which describes exactly the motion on that manifold. 

In most cases, we cannot solve the manifold condition (11.31) exactly, but we 
can approximate H(z, €) arbitrarily closely as a Taylor series at € = 0. The approx- 
imation procedure starts by substituting into (11.31) a Taylor series for H(z, €), 
namely, ` 
H(z, €) = Holz) + eHi(z) + €?Ho(z) +++- 
and by calculating Ho(z), Hi(z), and so on, by equating terms of like powers of 
e. This requires the functions f and g to be continuously differentiable in their 
arguments a sufficient number of times. It is clear that Ho(z) = H(z,0) = h(z). 
The equation for Hi(x) is 


29s (2) Hala) = frs ho) 


7We will not prove the existence of the invariant. manifold here. A proof can be done by a 
variation of the proof of (the center manifold) Theorem 8.1, given in Appendix C.15. (See [34, 
Section 2.7].) A proof under the basic assumptions of Theorem 11.1 can be found in [102]. 
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and has a unique solution if the Jacobian [8g/8z] at z = h(x) is nonsingular. 
The nonsingularity of the Jacobian is implied by the eigenvalue condition (11.16). 
Similar to Hj, the equations for higher order terms will be linear and solvable if the 
Jacobian [89/82] is nonsingular. 

To introduce the notion of a fast manifold, we examine (11.26)-(11.27) in the 
T =t/e time scale. At € = 0, z(7) = x(0), while z(r) evolves according to 


& = o(2(0),2) 


approaching the equilibrium point z = h(z(0)). This motion describes trajectories 
(z,z) in R"*™, which, for every given x(0), lie in a fast manifold F, defined by 
x = z(0) = constant and rapidly descend to the manifold z = h(x). For € larger than 
zero, but small, the fast manifolds are “foliations” of solutions rapidly approaching 
the slow manifold. Let us illustrate this picture by two second-order examples. 


Example 11.10 Consider the singularly perturbed system 


—E+2 
tan"! (1-2 — x) 


it = 
ez = 


At € = 0, the slow manifold is z = k(x) = 1 — x. The corresponding slow model 
p= —2r+1 


has an asymptotically stable equilibrium at z = 0.5. Therefore trajectories on the 
manifold z = 1 — z will be heading toward the point P = (0.5,0.5), as indicated 
by the arrow heads in Figure 11.8. Notice that (0.5,0.5) is an equilibrium point 
of the full system. The fast manifolds at € = 0 are parallel to the z-axis, with the 
trajectories heading toward the slow manifold z = 1 — z. With this information, 
we can construct an approximate phase portrait of the system. For example, a 
trajectory starting at point A will move down vertically until it hits the manifold 
z = 1-2 at point B. From B, the trajectory moves along the manifold toward 
the equilibrium point P. Similarly, a trajectory starting at point C will move up 
vertically to point D and then along the manifold to the equilibrium point P. For 
€ > 0, but small, the phase portrait of the system will be close to the approximate 
picture we have drawn at € = 0. Figure 11.9 shows the phase portrait for & = 0.1. 
The proximity of the two portraits is noticeable. A 
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Figure 11.8: Approximate phase portrait of Example 11.10. 


as state variables, t = s/u as the time variable, and € = l/p?^, the system is 
represented by the standard singularly perturbed model 


t = z e 


Ky 


We already know by the:Poincaré-Bendixson theorem, (Example.2.9) that the Van 
der Pol equation has a stable limit cycle. What we would like to do here is to use 
singular perturbations to have a better estimate of the location of the linit cycle. 
At € = 0, we need to solve for the roots z = h(x) of 


02-z4z—-i2 

The curve —z--z — 2/3 = 0, the slow manifold at € = 0, is sketched in Figure 11.10. 
For z « ~2/3, there is only one root on the branch AB. For —2/3 < x < 2/3, there 
are three roots, one on each of the branches AB, BC, and CD. For z > 2/3, there 
Is one root on the branch CD. For roots on the branch AB, the Jacobian 


8g 2 2 
8; 7177 «0, forz*>1 


Thus, roots on the branch AB (excluding a neighborhood of point B) are exponen- 
tially stable. The same is true for roots on the branch CD (excluding a neighbor- 
hood of point C). On the other hand, roots on the branch BC are unstable because 
they lie inthe region z? < Y. Let us construct an approximate phase portrait by us- 


ing singular, perturbations. We divide the state plane into three regions, depending 
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Figure 11.9: Phase portrait of Example 11.10 for € = 0.1. 


on the value of z. Trajectories starting in the region z « —2/3 will move parallel to 
the z-axis approaching the branch AB of the slow manifold. Trajectories starting in 
the region —2/3 < x < 2/3 will again be parallel to the z-axis, approaching either 
the branch AB or the branch CD, depending on the initial value of z. If the initial 
point is over the branch BC, the trajectory will approach AB; otherwise, it will 
approach C D. Finally, trajectories starting in the region x > 2/3 will approach the 
branch CD. For trajectories on the slow manifold itself, they will move along the 
manifold. The direction of motion can be determined by inspection of the vector 
field sign and is indicated in Figure 11.10. In particular, since $ = z, trajectories on 
the branch AB will be sliding down, while those on the branch CD will be climbing 
up. There is no point to talk about motion on the branch BC since there are no 
reduced models corresponding to the unstable roots on that branch. So far, we 
have formed an approximate phase portrait everywhere, except the branch BC and 
the neighborhoods of points B and C. We cannot use singular perturbation theory 
to predict the phase portrait in these regions. Let us investigate what happens in 
the neighborhood of B when e is positive, but small. Trajectories sliding along the 
branch AB toward B are actually sliding along the exact slow manifold z = H(z, c). 
Since the trajectory is moving toward B, we must have g « 0. Consequently, the 
exact slow manifold must lie above the branch AB. Inspection of the vector field 
diagram in the neighborhood of B shows that the trajectory crosses the vertical 
line through B (that is, x = 2/3) at a point above B. Once the trajectory crosses 
this line, it belongs to the region of attraction of a stable root on the branch CD; 
therefore, the trajectory moves rapidly in a vertical line toward the branch CD. 
By a similar argument, it can be shown that a trajectory moving along the branch 
CD will cross the vertical line through C at a point below C and then will move 
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f iei of 
Figure 11.10: Approximate phase portrait of the Van der Pol oscillator. 


^X ee 


vertically toward the branch AB. This completes the picture of the approximate 
portrait. Trajectories starting at any point are attracted to one of the two branches 


_ AB or CD, which they approach vertically. Once on the slow manifold, the trajec- 


tory will move toward the closed curve E — B — F — C — E, if not Already on it, 
and will cycle through it. The exact limit cycle of the Van der Pol oscillator will lie 
within an O(e) neighborhood of this closed curve. The phase portrait for € = 0.1, 
shown in Figure 11.11, confirms this prediction. l 

We can also estimate the period of oscillation of the periodic solution. The 
closed curve E — B — F — C — E has two slow sides and two fast ones. Neglecting 
the time of the fast transients from B to F and from C to E, we estimate the period 
of oscillation by tgp --trc. The time tgp can be estimated from the reduced model 


t= z 


0 = -r +z- 42? 


Differentiating the second equation with respect to t and equating the expressions 
for t from the two equations, we obtain the equation 


o z 
1-2? 


Fa 


which, when integrated from E to B, yields ten = (3/2) — 1n2. The time trc 
can be estimated similarly and, due to syminetry, tgp = tro. Thus, the period of 
oscillation is approximated for small € by 3 — 21n2. A 
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Figure 11.11: Phase portrait of the Van der Pol oscillator for £-01.- 
11.5 Stability Analysis 


We consider the Autonomous singularly perturbed system 


FULL SYSTEM t = f(zz) (11.33) 


EZ 


y 


g(z, z) (11.34) 
and assume that the origin (z — 0,z — 0) is an isolated equilibrium point and 
the functions f and g are locally Lipschitz in a domain that contains the origin. 
Consequently, : 
f(0,0) 20, (0,0) =0 
We want td: analyze the Stability of the origin by examining the reduced and 
boundary-layer models. Let z = A(z) be an isolated root of 
0 =9(z, z) 


defined for all z € D, C R”, where D, is a domain that contains z = 0. Suppose 
h(0) = 0. If z = A(z) is the only root of 0 = 9, then it must vanish at the origin, 
since 9(0,0) = 0. If there are two or more isolated roots, then one of them must 
vanish at x = 0, and that is the one we must work with! It is more convenient to 
work in the (x, y)-coordinates, where C f 


y =z- h(z) 


because this change of variables shifts the equilibrium of the boundary-layer model 
to the origin. In the new coordinates, the singularly perturbed system is 


4 ż = f(zny-h(z) (11.35) 
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ey = o(a,y + hz) - e a Fey + h(a) (11.36) 


Assuming that [A(x ion, the 
map y = z — h(z) is stability preserving; that is, the origin of (11.33)-(11.34) is 
asymptotically stable if and only if the origin of (11.35)-(11.36) is asymptotically 
stable. The reduced system 


z= f(z, h(z)) (11.37) 
has equilibrium at z = 0 and the boundary-layer system 
dy 
d. 7 9v + ha) (11.38) 


where 7 = t/e and z is treated as a fixed parameter, has equilibrium at y = 0. 
The main theme of our analysis is to assume that, for each of the two systems, the 
origin is asymptotically stable and that we have a Lyapunov function that satisfies 
the conditions of Lyapunov’s theorem. In the case of the boundary-layer system, 
we require asymptotic stability of the origin to hold uniformly in the frozen param- 
eter z. We have already defined what this means in the case of an exponentially 
stable origin (Definition 11.1). More generally, we say that the origin of (11.38) is 
asymptotically stable uniformly in x if the solutions of (11.38) satisfy 


llv(r)] < &(y(0,7), Vr 20, Vee D. 


where @ is a class KL function. This conditions will be implied by the condi- 
tions we will impose on the Lyapunov function for (11.38). Viewing the full sin- 
gularly perturbed system (11.35)-(11.36) as an interconnection of the reduced and 
boundary-layer systems, we form a composite Lyapunov function candidate for the 


full system as a linear combination of the Lyapunov functions for tlie reduced and . 


boundary-layer systems. We then proceed to calculate the derivative “of thé com- 
posite Lyapunov function along the trajectories of the full system and verify. under 
reasonable growth conditions on f and g, that the composite Lyapunov function 
will satisfy the conditions of Lyapunov's theorem for sufficiently small €. 

Let V(x) be a Lyapunov functiorf for the reduced systeiri (11:37) such that 


BY eha) Savile), MDO (11.39) 


' for all z € Dz, where y, : R” > Risa positive definite function; that is, v4 (0) = 0 


and ¥(x) > 0 for all z € Dz — {0}. Let W(z,y) be a Lyapunov function for the 
boundary-layer system (11.38) such that 
ow d 9 
Bru + h(a) S-ova) o, 27° (11.40) 
y - 


for all (x.y) € D. x Dy. where Dy C R™ is a domain that contains y = 0, and 
VS eR" = Risa positive delinite function; that is. 3(0) = 0 and v«(y) > 0 for 


all y € Dy — (0). We allow the Lyapuno 
a parameter of the system and Lyapunov 
system’s paraineters. Because z is not a 
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v function W to depend on 2, since x is 
functions may, in general, depend on the 
true constant parameter, we have to keep 
V on z. To ensure that the origin of (11.38) 


f the dependence of 1 
esiste iA p we assume that W(x, y) satisfies 


is asymptotically stable uniformly in z, 


Wy(y) € W(z,y) € Waly), V (2,9) E€ Ds xX Dy 
Now consider the com- 


(11.41) 


for some positive definite continuous functions W, and Wo. 
posite Lyapunov function candidate 


v(z,y) = (1- d)V(z) + dW(z,y), 0«d«1 
Calculating the derivative of v along the 


(11.42) 


where the constant d is to be chosen. 
trajectories of the full system (11.35)-(11.36), we obtain 


l y 
gos a) fly +h(x)) + e gley + h(z)) 
8W 8h aw 
z day pa y sh) ie Um f(z,y* d 
= Q- penta) + SG ate + D) 
Int A 


«a - d iro. ho) - fes hm) 


i ! Mt B 
OW _ S| sey + Ma) 
Oz Oy Ox 

er The first two terms 

We have represented the derivative P as the sum of ie Mens air ae 
ivati he trajectories o: 
are the derivatives of V and W along the tri s of : eee 
tive definite in z and y, resp ; 

laver systems. "These two terms are nega EA ettet ote 
inequaliti : .40). The other two terms represent t 
inequalities (11.39) and (11 ot deu 
i i fast dynamics, which is neg 
nterconnection bctween the slow and 
diee terms are, in general, indefinite. The first of these two terms 


OV flay 4- h(z)) — F(z, h(2))] 
Ox 


represents the effect of the deviation of (11.35) from the reduced system (11.37). 


The other term 
ii ow. B) fay + hta) 
ôr  ðy ax : 


he boundary-layer system (11.38), as well 


represents the deviation of (11.36) from t love analysis, Suppose et ties: 


as the effect of freezing x during the boundary- 
perturbation terms satisfy 


OV fs, y + h(x) - Fle hla) < Avi noQ (11.43) 
Ox l r 
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aid Wa 
wW we jlo, y + h(z)) < Bath (2)va(y) + vil) (1144) 
Ox dy Ox ^ ^ 
= 


for some nonnegative constants (1, 82, and "y. Using inequalities (11.39), (11.40), 
(11.43), and (11.44), we obtain. 


< -0 - djowl(z) - Sess) + (1 - diva (o)¥a(0) 


+ dfybi (2)a (y) + di (y) 
zo (z,y)Av(z.y) 
ener t mote a 


| Vi (x) | 
ylz, y) = 
oly) 


| . 0-d) -ia- )& ~ idf | 
A= 


-l(1-d)À — id& d((a2/e) ~ 7) 


The right-hand side of the last inequality is a quadratic form in V. The quadratic 
form is negative definite when _ 


v 
tom 


where 


and 


|^l»o d(1— d)an (2 - 7) »i(-44- dpa? 


which is equivalent to 


a m (11.45) 


d 
<r 
E< cart gall - DA + dés 


\ , n 
The dependence of e4 on d is sketched in Figure 11.12. It can be easily seen that 
the maximum value of £4 occurs at d* = fi/(E + £2) and is given by 


ea Qlaz 
~ ony + Bis 


It follows that the origin of (11.35)-(11.36) is asymptotically stable for all € < gh. 
Theorem 11.3 summarizes our findings. 


(11.46) 


Theorem 11.3 Consider the singularly perturbed system (11.35) and (11.36). As- 
sume there are Lyapunov functions V(x) and W(z,y) that satisfy (11.39) through 
(11.41), (11.43), and (11.44). Let eq and &* be defined by (11.45) and (11.46). 
Then, the origin of (11.35) and (11.36) is asymptotically stable for all 0 € & « e*. 
Moreover, v(z,y), defined by (11.42), is a Lyapunov function for € € (05). © 


Figure 11.12: Upper bound on e. 


The stability analysis that led to Theorem 11.3 delineates a procedure for con- 
structing Lyapunov functions for the singularly perturbed system (11.35)-(11.36). 
We start by studying the reduced and boundary-layer systems, searching for Lya- 
punov functions V(x) and W(z, y) that satisfy (11.39) through (11.41). Then in- 
equalities (11.43) and (11.44), which we will refer to as the interconnection con- 
ditions, are checked. Several choices of V and W may be tried before one finds 
the desired Lyapunov functions. As a guideline in that search, notice that the 
interconnection conditions wil be satisfied if 


Iz | s evoca: Mts hon < avala) 
VG A(2)) — fle, h(2))l < Keds (v) 


I S kao(y); Ed S ksys(y) 


A Lyapunov function V (z) that satisfies (11.39) and ||OV/Oxl|| € kıyı (zx) is known 
as a quadratic-type Lyapunov function, and v, is called a comparison function. 

Thus, the search would be successful if we could find quadratic-type Lyapunov 

functions V and W with comparison functions y; and v» such that ||f(z, h(2x))|| 

could be bounded by yi(z) and ||f(z,y + h(z)) — f(x, h(z))]| could be bounded 

by yo(y). If we succeed in finding V and W, we can conclude that the origin is. 
asymptotically stable for € < e*. For a given € < e*, there is a range (di; d2), 
illustrated in Figure 11.12, such that for any d € (dj, dz), the function ?(z;y) = 

(1 — d)V (z) + dW (s, y) is a valid Lyapunov function. The freedom in choosing d 

can be used to achieve other objectives, like improving estimates of the region of 

attraction. 
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Example 11.12 The second-order system 
i$ = f(x,z)=2—-x224+2 
eż = g(zz)2-r-z. 


has a unique equilibrium point at the origin. Let y = z — h(x) = z + z and rewrite 
the system as 


i = -r+ y 
ey = -yce(-25 +y) 
For the reduced system 
i= -r 


we take V(x) = (1/4)z^, which satisfies (11.39) with Yı (x) = |r|? and a, = 1. For 
the boundary-layer system 

dy _ 

dr 1 
we take W (y) = (1/2)y?, which satisfies (11.41) with do(y) = |y| and a2 
for the interconnection conditions of (11.43) and (11.44), we have 


D flay + hir) = fis h(a))] = zy < dads 


and 
ow 
ay {try + HE) = wo ey) Sio + va 
Note that OW/Oxr = 0. Hence, (11.43) and (11.44) are satisfied with 2; = 8; = 
y = 1. Therefore, the origin is asymptotically stable for € < ¢* = 0.5. In fact, 
since all the conditions are satisfied globally and v(z, y) = (1 — d)V (x) + dW(y) is 
radially unbounded, the origin is globally asymptotically stable for € < 0.5. To see 
how conservative this bound is, let us note that the characteristic equation of the 
linearization at the origin is 
+ G - 1) à=0 
E 


which shows that the origin is unstable for ¢ > 1. Since our example is a simple 

second-order system, we may calculate the derivative of the Lyapunov function 
v(z,y) = =T t3V 

along the trajectories of the full singularly perturbed system and see if we can get 

a less conservative upper bound on & compared with the one provided by Theo- 

rem 11.3: 


EA 
Ht 


d 
(1 —d)z3(-23 + y) - au + dy(—2z? + y) 


-(1- d) + (1 - 2d)r3y — d G - 1) y? 


1. As | 
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It is apparent that the choice d = 1/2 cancels: the cross-product terms and yields 


1 1/1 ) 
pcdes T ue 
og 5 (2 y 


which is negative definite for alle « 1. This estimate is indeed less. conservative 
than that of Theorem 11.3. In fact. it is the actual range of € for which the oiia 
is asymptotically stable. 


Example 11.13 The system 


t = -rctz 
tan! (1— 2 — z) 


ez 
has an equilibrium point at (0.5,0.5). The change of variables 


ie 


9.5, Z 


ld roan 


shifts the equilibrium point to the origin. To simplify the notation, let us drop the 


tilde and write the state equation as 


i = -—rtz 
gà = —tan™ (r+ z) 
The equation 
= —tan !(z + z) 
hes a unique root z = A(z) = —2. We apply the change of variables y = z +z to 
obtain 


i = —2r+y Pais? 
ey —tan"! y +e(-22 + y) 


For the reduced system, we take V(x) = (1/2)2?, which satisfies (11.39) da a m. 
and Vi(z) = |z|. For the boundary-layer system, we take W(y) = (1/2)y 


(11.40) takes the form 


tan} p 9 
. dW -l l=- -l y < — ———y 
mpi a y--ytan y <S F 


= . Thus, (11.41) is satisfied with a2 = (tan? p)/p 
a ( 2s mm n ed ten eds (11.43) and (11.44) are purus 
E ball ‘vith B = 1, £5 = 2, and 7 = 1. Hence, the origin is asymptotically d è 
Por ae <eé* Stans? p)/2p. In fact, the origin is exponentially stable, since a 
v and the negative definite upper bound on ù are quadratic in (x,y). 
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The Lyapunov analysis we have just presented can be extended to nonau- 
tonomous systems. We will not give the details here;® instead, we consider the 
case of exponentia] stability and use converse Lyapunov theorems to prove a result 

- of coriceptual-importdnce. 
Theorem 11.4 Consider the singularly perturbed system 
"fts, 2,€) (11.47) 


glt, z, 2, €) (11.48) 


9 
wh LL ^ 


i 


ez 
Assume that the following assumptions are satisfied for all 
(t,2,&) € [0, 00) x Rx [0, €o] 
e f(t,0,0,€) =0 and g(t, 0,0,¢) = 0. beste c 


e The equation 
, . 0 = g(t, z, 2,0) 


has un isolated root z = h(t,z) such that h(t, 0) = 0. 


e The functions f, g, lls and their partial derivatives up to the second order. gre 
bounded for. Za jb t) E RD a] de 


* The origin of the reduced system 
| è = f(t,2, A(t,2), 0) 
. ds exponentially stable. 


e The origin of the boundary-layer system 
dy ] 
dr T. g(t, T,y + k(t, z), 0) 
is exponentially stable, uniformly in (t, x). 
Then, there exists &* > 0 such that for alle < &*, the origin of (11.47)-(11.48) is 
exponentially stable. o 


Proof: By Theorem 4.14, there is a Lyapunov function V(t, x) for the reduced 


system that satisfies 
eilla]? € V(t2) € ezla? i 

YM usas safer ^ CshbrlA 

xpo vane] 


Oz 


5A detailed treatment of the nonautonomous case can be found in [105, Section 7.5]. 
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for some positive constants cj, i = 1,...,4, and for z € Bey where rg < r. By 
Lemma 9.8, there is a Lyapunov function W (t, x, y) for the Boundary-layer system 
that satisfies 

biliyi? € W(tz,y) < bellyll? 


ow 
By ^ ty + h(t, z), 0) < —bslyl? 


ow 
—-|| < 
| dut 
aw oW 
OW lle 2, |" 2 
0 Esser: [| stt 
for some positive constants b;, i= 1,...,6, and for IE where po € p. Apply ` 
the change of variables psum 
y-z-h(tz) 
to transform (11.47)-(11.48) into 
$ = f(t,c,y+ h(t,z),e) (11.49) 


«= olay +h(t,2),0)— 2% 


TS oF rq, zy h(t, zr), £) (11.50) 
T 
We are going to use 
u(t, x, y) x V(t, z) + W(t,z, y) 


as a Lyapunov function candidate for the system (11.49)-(11.50). In preparation 
for that, let us note the following estimates in the neighborhood of the origin: Since 
f and g vanish at the origin for all é € [0, £o], they are Lipschitz in € linearly in the 

state (x,y). In particular, i 


[f(t £, y + h(t,z), €) T f(t, my h(t, x), 0)|| < eL (||| + lvl) 


lo(t zy + h(t, x), e) — g(t, y + h(,2),0)]] < eLa(lzl| + ||y]]) 


Also, 
F(t, zy h(t, z),0) — f(t,z, h(t, z), 0)J < Lally) 


HG x, h(t, x), 0)|| < L; lz 
| | ah | J 


ôt ðr 


where we have used the fact that f(t,z,h(t,x),0) and h(t, £) vanish at z = 0 for 
all t. Using these estimates and the properties of the functions V and W, it can 


< ky |x|; Ske 
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be verified that the derivative of v al 


the inequality ong the trajectories of (11.49)-(11.50) satisfies 


. 3 2 a: 
POS -alzlt cool? - yl? + asl? 
* asljzl Iyl + aelzll ivl? + arllyll? 


with positive a, and a3 and nonnegati 
: gative az and a4 to a;. i 
inequality simplifies to : en anes 


* . . * 
* * - * 


= 2 a3 
» S -ajz|[l* + eas|[z||? — = lll + asllyll? + 2as|l]| |l] 
1T 
III} 01 — €a? —ag lzi] 
lxii —a9 — (az/e) ~ ag llyll 


Thus, there exists e* > 0 such that for all 0 < € < e*, we have 
bp < —2yv 
: for some y > 0. It.follows that 


v(t, a(t), y(t) S exp[-2y(t — to)]v(to, 2(to), y(to)) 


and, from the properties of V and W ; 


z(to) 
y(to) 


we) | s f expl- = to) 


Since y = z — h(t, z) and ||A(t, 2)|| < kz 


z||, we obtain 


z(to) 
Z(to) 


NY | S Kaexp[-*(t — to) 


which completes the proof of the theorem. a 


Theorem 11.4 is conceptually important because it establishes robustness of 
exponential stability to unmodeled fast (high-frequency) dynamics. Quite often 
in the analysis of dynamical systems, we use reduced-order models obtained b 
neglecting small “parasitic” parameters. This reduction in the order of the iid 
can be represented as a singular perturbation problem, where the full singularly 
perturbed model represents the actual System with the parasitic parameters and the 
reduced model is the simplified model used in the analysis. It is quite reasonable to 
assume that the boundary-layer model has an exponentiaily stable origin. In fact 
if the dynamics associated with the parasitic elements were unstable, we should not 
have neglected them in the first place. The technicalities of i 
stability instead of only asymptotic stability. or asstuning-that exponential stabilit y 
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holds uniformly, are quite reasonable in most applications. It is enough to inention 
that all these technicalities will automatically hold Era 
linear. When the origin of the reduced model is exponentially stable, Theorem 11. 

assures us that the origin of the actual system will be exponentially stable, provided 


the neglected fast, dynamics axe sufficiently fast. The next example illustrates how 
this robustness property arises in control design. 


Example 11.14 Consider the feedback stabilization of the system 


fst»)  — X lek eu 3. 


Eż = Az+Bu 
Wada Gi 4— Lined om 3 


where f(t,0,0) = 0 and A is a Hurwitz matrix. The system has an open-loop 
equilibrium point at the origin, and the control task is to design a state feedback 
control law to stabilize the origin. The linear part of this model represents actuator 
dynamics, which are, typically, much faster than the plant dynamics represented by 
the nonlinear equation z = f. To simplify the design problem, we may neglect the 
actuator dynamics by setting € = 0 and substituting v = —C A^! Bu into the plant 
equation. To simplify the notation, let us assume that -CA~!B = I and write the 
reduced model as 


i 


i= f(tz,u) 

We use this model to design a state feedback control law E = (t, 2) uct that the 
origin of the closed-loop model ne 

-RE = fta, v(t, 2)) " 


is exponentially stable. We will refèr to this model as the nominal-closed-loop 
system. Will the control law stabilize the actual system with the actuator dynamics 
included? When the control is applied to the actual system, the closed-loop equation 
is . 


f(t, v, Cz) 
ez = Az+By7(t,2z) 


i 


We have a singular perturbation probleii, where the full singularly perturbed model 
is the actual closed-loop system and the reduced model is the nominal closed-loop 
system. By design, the origin of the reduced model is exponentially stable. The 
boundary-layer: model 


is independent of (t,x) and its origin is exponentially stable since A is a Hurwitz 


matrix. Assuming that f and 7 are smooth enough to satisfy the conditions of 


Theorem 11.4, we conclude that the origin of the actual closed-loop system is ex- 
‘ponentially stable for sufficiently small €. This result legitimizes the ad hoc model 


. ‘simplification process of neglecting the actuator dynamics. A 


nt i AA e ARES A CIPUE NE: iE Ea IRS, C eat 
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b 11.6 Exercises 11.5 Show that if the Jacobian [0g/Óy] satisfies the eigenvalue condition (11.16), 
y 2 / i then there exist constants k, y, and pp for which inequality (11.15) is satisfied. 
~, i ircuit of Figure 11.13 and suppose the capacitor C2 is f LO. 
+ in eee ME NA d R. Represent the system in the standard 11.6 Show that if there is a Lyapunov function satisfying (11.17) and (11.18), then 
P Busen be pr form inequality (11.15) is satisfied with the estimates of (11.19). 
: 81 s 
A 11.7 Consider the singular perturbation problem " 
» R: Rı ; 
z t= +z, 2(0)=€ 
x e£ = z?-z+1, 2(0)=7 
^ + + + (a) Find an O(e) approximation of z and z on the time interval [0, 1]. 
Ji u v2 C3 Ui Ci 
` _ = m (b) Let € = — 0. Simulate z and z for 
= (1)e=0.1 and (2) ¢=0.05 
d. i and compare with the approximation derived in part (a). In carrying out the 
id Figure 11.13: Exercises 11.1 and 11.2. computer simulation, note that the system has a finite escape time shortly 
À f after t=1. 


PR IRIS IBIS IRONIC 


11.2 Consider the RC circuit of Figure 11.13 and suppose the resistor Ry is small 
relative to Ro, while C1 = C2 = C. Represent the system in the standard singularly 


perturbed form. 

11.3 Consider the tunnel diode circuit of Section 1.2.2 and suppose the inductance 
L is relatively small so that the time constant L/R is much smaller than the time 
constant CR. Represent the system as a standard singularly perturbed model with 
e= LJCR?. 

11.4 ([105]) The feedback system of Figure 11.14 has a high-gain amplifier with 
gain k and a nonlinear element 7. Represent the system as a standard singularly 
perturbed model with € = 1/k. 


Figure 11.14: Exercise 11.4. 


11.8 Consider the singular perturbation problem 


i 


rz, 2(0)=£ 
- = ten”? (2 + 2)) ; 20)=n 


EZ 
(a) Find an O(c) approximation of x and z on the time interval [0, 1]. 
(b) Let =n — 1. Simulate z and z for 
(1)£202 and (2)e=0.1 
and compare with the approximation derived in part (a). 


11.9 Consider the singularly perturbed System 


$—2,  ti-—r-tz-exp(2)--1-u(t) 


Find the reduced and boundary-layer models and analyze the stability properties - 
of the boundary-layer model. SEES. 


11.10 ([105]) Consider the singularly perturbed system 
QE : 
pe Eż = —(z + 2t)(z - 2)(z = 4) 


(a) How many reduced models can this system have? 
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(b) Investigate boundary-layer stability for each reduced model. 


(c) Let z(0) = 1 and 2(0) =a. Find an O(e) 
interval [0, 1] for all values of a in the interval [-2. 6]. 
11.11 Apply Theorem 11.2 to study the asymptotic behavior of the system 
$--—z-z-—sint, Eż = —z + sint | 
as t — oo. 
11.12 ([105]) Find the exact slow manifold of the system . 
=r,  eż=-z>-g/34 $ex16/3 


11.13 ([105]) How many slow manifolds do 


es the following system have? Which 
of these manifolds will attract trajectories of 


the system? 
t= -rz ef = —(z — sin? z)(z — €*7)(2 2e?'7), a>0 
11.14 ([105]) Consider the linear autonomous singularly perturbed system 
$ = Auri 
€ = Agart Anoz 
where z € R”, z € R™, and 422 is a Hurwitz matrix. 
(a) Show that for sufficiently small e, the system has an exact slow manifold z — 
—L(s)z, where L satisfies the algebraic equation 
-eL(Au — A122) = Az — Ago 


(b) Show that the change of variables n = z + L 


(€)z transforms the system into a 
block triangular form, ` 


(c) Show that the eigenvalues of the system cluster into a group of n slow eigen- 

values of order O(1) and m fast eigenvalues of order O(1/e). 
(d) Let H(e) be the solution of the linear equation 

e(An — Ai2L)H — H(A + €LAj2) + Ai; =0 
Show that the similarity transformation 
PE El i 
D L I z 
transforms the system into the block modal form 
C= A6 h= Agle)n 


where the eigenvalucs of As and A;/e are, respectively, the slow and fast 
cigenvalues of the full singularly perturbed system, 


approximation of z and z on the tiine 
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(e) Show that the component of the fast mode in z is O(e). 
(f) Give an independent proof of Tikhonov's theorem in the current case. 


11.15 Consider the linear singularly perturbed system 


i = Auz t Ai2z t Biu(t), z(0) E 
EZ = ÁT + Ágoz + Bou(t), z(0) -1) 


where x € R”, z € R", u € RP, Ago is Hurwitz, aud u(t) is uniformly bounded for 
all t > 0. Let z(t) be the solution of the reduced system 


t= Aoz + Bou(t), xr(0)=€é 
where Ag = Aj) — 412422 Az and Bo = By — A1243} Bo. 
(a) Show that z(t,£) — Z(t) = O(e) on any compact interval [0, t;]. 
(b) Show that if Ag is Hurwitz, then x(t, €) — Z(t) = O(e) for all t > 0. 


Hint: Use the transformation of the previous Exercise. 


11.16 Consider the singularly perturbed system 
£1 T3, do = -T2 + 2, eż = tan !(1— 2, — z) 
(a) Find the reduced and boundary-layer models. 
(b) Analyze the stability properties of the boundary-layer model. 
i imation of the solution. 
Let z,(0) = z2(0) = z(0) = 0. Find an O(e) approxima c à 
2 ae : numerical algorithin, calculate the exact and approximate solutions 
over the time interval [0, 10] for ¢ = 0.1. 


(d) investigate the validity of the approximation on the infinite time interval. 


(e) Show that the system has a unique equilibrium point and analyze its eund es 
using the singular perturbation approach. Is the equilibrium point o : 
ically stable? Is it globally asymptotically stable? Is it exponentia y s mA 
Calculate an upper bound e* on € for which your stability analysis is valid. 


11.17 Repeat Exercise 11.16 for the singularly perturbed system 
i=—2r +r? +z, e2-2z—z5-z 


In part (c). let z(0) = z(0) = 1 and the time interval be (0, 5]. 


i "* 
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E 11.18 Repeat Exercise 11.16 for the singularly perturbed system 

E LESE T es = —2r4/? — 2z 

: : In part (c), let z(0) = 2(0) = 1 and the time interval be [0, 1]. 

A 11.19 Repeat Exercise 11.16 for the singularly perturbed system 

F i = =x? + tan™} (z), ei2-r-z 

P In part (c), let z(0) = —1, z(0) = 2 and the time interval be [0, 2]. 

c 11.20 Repeat Exercise 11.16 for the singularly perturbed system 

5 i = -T + z1 + 22 + 2122, eż = —Z1, Eža = —23 — (£ + 21 + T21) 

2 In part (c), let z(0) = z1(0) = 22 (0) = 1 and the time interval be 0, 2]. 

i à 11.21 Consider the field-controlled DC motor of Exercise 1.17. Let v, = Va = 
p constant, and vy = U = constant. 


OO D, Jh, ER, S.J ONCOL UU ERU 


(a) Show that the system has a unique equilibrium point at 


I U L - C3 Va B cQ V,U/R; 
= — d = = 
f= Re 74> OR, + c1cqU?/ Re ca Ra + cy29U 2 R3 
f f 1 f 


We will use (Zf, Ia, 9) as a nominal operating point. 


(b) lt is typical that the armature circuit time constant T4 = La/Ra is much 
smaller than the field circuit time constant Ty = Ly/Ry and the mechanical 
time constant. Therefore, the system can be modeled as a singularly perturbed 
system with i; and w as the slow variables and i, as the fast variable. Taking 
zjcdf/Ilg, Bo = W/O, z e u = v,/U, and € = Ta/Tj, and using 
t = t/T; as the time variable, show that the singularly perturbed model is 
given by : 


, 


di--—zX1-cu £2 ='a(r12z — 12), ez = —z — ba, Z2+¢ 


where a = Lyc3/RyJ, b= c1 c9U? / cs RaR, c = Va /Ia Ra, and () denotes the 
derivative with respect to t’. 


(c) Find the reduced and boundary-layer models. 
(d) Analyze the stability properties of the boundary-layer model. 


‘eo 


(e) Find an O(c) approximation of x and z. 


(f) Investigate the validity of the approximation on the infinite time interval. 


a $, 


Sama Were e 
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Aet. 4 ovn 


(g) Using a numerical algorithm, calculate the exact and approximate solutions for 
a unit step input at u and zero initial states over the time interval (0, 10] for 
€ = 0.2 and € = 0.1. Use the numerical data cj = cp = V2 x 107? N-m/A, 
c3 = 6 x 1079 N-m-s/rad, J = 1075 N-m-s?/rad, Ra = Ry =1 Q, Ly 202 
H, V, = 1 V, and U 202 V. 


11.22 ([105]) Consider the singularly perturbed system 
: i z 
& = —n(z)-az, he cos eg 
where a is a positive constant and 7 is a smooth nonlinear function that satisfies 
7(0) 20 and zn(z)>0, for x € (—o0o,5) — (0) 


for some b > 0. Investigate the stability of the origin for small e by using the 
singular perturbation approach. 


11.23 ([105]) The singularly perturbed system 
i=-—2r +27, eg =a? -tanz 
has an isolated equilibrium point at the origin. 
(a) Show that asymptotic stability of the origin cannot be shown by linearization. 


(b) Using the singular perturbation approach, show that the origin is asymptoti- 
cally stable for € € (0,£*). Estimate e* and the region of attraction. 


11.24 ([105]) Let the assumptions of Theorem 11.3 hold with V4 (z) = |[z|| and 
Vo(y) = ||y|| and suppose, in addition, that V(x) and W(z, y) satisfy 


killzl? < V(x) < balls)? 
ksllyl? < W(z;y) < kaliyli? d 


V (z, y) € Da x Dy, where kı to k4 are positive constants. Show that the conclusions 
of Theorem 11.3 hold with exponential stability replacing asymptotic stability. 


11.25 ([191]) Consider the singularly perturbed system 


f(z,y) 
ey = Ayt+eg(z,y) 


i 


where A is Hurwitz and f and g, are sufficiently smooth functions that vanish at 
the origin. Suppose there is a Lyapunov function V(x) such that [8V/8z|f (2,0) < 
—a¢(z) in the domain of interest, where o > 0 and ¢(z) is positive definite. Let P 
be the solution of the Lyapunov equation PA-- AT P = —I and take W(y) = y? Py. 
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uL (a) Suppose f and g, satisfy the inequalities 


llg(z,0)lo < &:9!](z), 20 


av... 
az V 9) - f(,0) < ko!" (z)|ylla, k2 20 


in the domain of interest. Using the L i i p 

. yapunov function candidate v(x, y) = 
(1— d)V(z) + dW (y), 0 « d « 1 and the analysis preceding Theorem m 
show that the origin is asymptotically stable for sufficiently small e. 


(b) As an alternative to Theorem 11.3, suppose f and gi satisfy the inequalities 


llgs(z,0)]la € kaó^(z), ks 20, 0a i 


V j 
ar Ue -Ae < d"), k20, 0<b<1, c= H 
a 
in the domain of interest. Using the L i i 
. yapunov function candidate v(x, y) = 
V (z)2- (yT Py)”, where y = 1/2a, show that the origin i i i 
, , tot É 
for sufficiently small e. ; POTIUS 
Hint: Use Young's inequality 


1 
uw S a Eur TuP T uz 0, w20,u20,p»1 


to show that ù € —c1ó — ca|y|I2". Then show that the coefficients c; and cz 
can be made positive for sufficiently small e. 


(c) Give an example where the interconnection conditions of part (b) are satisfied 
but not those of part (a). . 


11.26 ([99]) Consider the multiparameter singularly perturbed system 


t = f(z,z1,...,zm) 
m 
jz = m(z) + Y 04525, i=1,...,m 
. jel f 


where i is an n-dimensional vector, z;'s are scalar variables, and ¢;’s are small 
positive parameters. Let € = max; €;. This equation can be rewritten as 


0$ = f(z,z) 
eDi = n(x)+ Az 


» where z and 7 are m-dimensional vectors whose components are z; and rj, respec- 
tively, A is an m x m matrix whose elements are a;;, and D is an m x m diagonal 
matrix whose ith diagonal element is ¢;/¢. The diagonal elements of D are positive 
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and bounded by one. Suppose the origin of the reduced system t = f(z, - A7!n(z)) 
is asymptotically stable and there is a Lyapunov function V(x) that satisfies the 
conditions of Theorem 11.3. Suppose further that there is a diagonal matrix P with 
positive elements such that 


PA+A™P=-Q, Q>0 
Using 
v(x, z) = (1— d)V(z) + d(z + A7!y(z))! PD(z + A7'n(z)), 0«d«1 
as a Lyapunov function candidate, analyze the stability of the origin. State and 
prove a theorem similar to Theorem 11.3 for the multiparameter case. Your conclu- 
sion should allow the parameters c;'s to be arbitrary, subject only to a requirement 
that they be sufficiently small. 
11.27 ([105]) The singularly perturbed system 


2, = (a+ x2)x1 + 2z, ig = bz, EZ = —1,22—2 


where a > 0 and b > 0, has an equilibrium set {z; — 0, z = 0). Study the asymp- 
totic behavior of the solution, for small e. using LaSalle’s invariance principle. 
Hint: The asymptotic behavior of the reduced model has been studied in Exam- 
ple 4.10. Use a composite Lyapunov function and proceed as in Section 11.5. Notice, 
however, that Theorem 11.3 does uot apply to the current problem. 

11.28 Show that the origin of the system 


tı = T2 + e™tz, 


ig = -T2 +2, ci = -(zxitz)- (tı + zy 
is globally exponentially stable for sufficiently small €. 
11.29 Consider the singularly perturbed system 
ga -r+ tan! s, zi=-r-z+u 


(a) Find e* such that Ve < €", the origin of the unforced system is globally 
asyinptotically stable. 


(b) Show that for each £ < e*, the system is input-to-state stable. 


11.30 Consider the feedback connection of Figure 7.1, where the linear component 
is a singularly perturbed system represented by 


ii = T2 

dg = -T -2r +z 
es = —z+u 

y = 2xictzo 


and v) is a smooth, memoryless, time-invariant nonlinearity that belongs to a sector 
[0, k] for some k > 0. ; 
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(a) Represent the closed-loop system as a singularly perturbed system and find its 
reduced and boundary-layer models. 


(b) Show that for every k > 0, there is £* > 0 such that the system is absolutely 
stable for all 0 < € < &*. 


Chapter 12 e 


Feedback Control 


The last three chapters of the book deal with the design of feedback control. Vari- 
ous tools of nonlinear control design are introduced, including linearization, integral 
control, gain scheduling, feedback linearization, sliding mode control, Lyapunov re- 
design, backstepping, passivity-based control, and high-gain observers. Most of the 
nonlinear analysis tools we have learned so far come into play in these three chap- 
ters, solidifying our understanding of these tools. This chapter starts with a section 
on control problems that serves as an introduction to all three chapters. This is fol- 
lowed by four sections on classical tools, which proved to be useful in applications, 
namely, linearization, integral control, and gain scheduling. Feedback lineariza- 
tion is presented in Chapter 13 and various nonlinear design tools are presented in 
Chapter 14. 
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12.1 Control Problems 


There are many control tasks that require the use of feedback. Depending on the 
design goals, there are several formulations of the control problem. The tasks of 
stabilization, tracking, and disturbance rejection or attenuation (and various com- 
binations of them) lead to a number of control problems. In each problem, we ' 
may have a state feedback version where all state variables can be measured or an 
output feedback version where only an output vector, whose dimension is typically 
less than the dimension of the state, can be measured. In a typical control prob- 
lem, there are additional goals for the design, like meeting certain requirements 
on the transient response or certain constraints on the control input. These re- 
quirements could be conflicting and the designer has to trade off various conflicting 
requirements. The desire to optimize this design tradeoff leads to various optimal 
control problems. When model uncertainty is taken into consideration, issues of 
sensitivity and robustness come into play. The attempt to design feedback control 
to cope with a wide range of model uncertainty leads to either robust or adaptive 
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control problems. In robust control, the model uncertainty is characterized as per- 
turbations of a nominal inodel. You may think of the nominal model as a point 
in a space and the perturbed models as points in a ball that contains the nominal 
model. A robust control design tries to meet the control objective for any model 
in the “ball of uncertainty.” Adaptive control, on the other hand, parameterizes 
the uncertainty in terms of certain unknown parameters and tries to use feedback 
to learn these parameters on-line, that is, during the operation of the system. In a 
more elaborate adaptive scheme, the controller might be learning certain unknown 
nonlinear functions, rather than just learning some unknown paraineters. There 
are also problem formulations that mix robust and adaptive control. In the current 
section, we describe the control problems we shall encounter in this chapter and the 
next two. We will limit our discussions to the basic tasks of stabilization, track- 
ing, and disturbance rejection. We start with the stabilization problem, both state 
feedback and output feedback versions. Then we describe tracking and disturbance 
rejection problems. Some robust control problems will be described in Chapter 14, 
as needed. 
The state feedback stabilization problem for the system 


i = f(t, T, u) ; 
is the problem of designing & feedback control law 


u — (tz) 


such that the origin z = 0 is a uniformly asymptotically stable equilibrium point of 
the closed-loop system 
i= f(t, 2, y(t, 2)) 


The feedback control law u = 4(t, z) is usually called "static feedback," because it 
is & memoryless function of z. Sometimes, we use & dynamic state feedback control 


u= q(t, 2,2) 
where z is the solution of a dynamical system driven by x; that is, 
z= g(t, z,z) 


Common examples of dynamic state feedback control arise when we use integral 
control (Section 12.3) or adaptive control (Section 1.2.6). 
The output feedback stabilization problem for the system 


= f(t,z,u) 
y = h(t,x,u) 


is the problem of designing a static output feedback control law 


u (ty) 
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or a dynamic output feedback control law 


a(t y, 2) 
g(t.y.z) 


u 


> 
a 


such that the origin is a uniformly asymptotically stable equilibrium point of the 
closed-loop system. In the case of dynamic feedback control, the origin to be sta- 
bilized is (z = 0, z = 0). Dynamic feedback control is more common in output 
feedback schemes, since the lack of measurement of some of the state variables is 
usually compensated for by including "observers" or "observer-like" components in 


the feedback controller. ur 
While the standard stabilization problem is defined as stabilization of an equi- 


‘librium point at the origin, we can use the same formulation to stabilize the system 


with respect to an arbitrary point Tss. For that we need the existence of a steady- 
state value of the input uss which can maintain equilibrium at Tss; namely, 


0 = f(t, Tss, Uss): Vt20 


The change of variables 
T = T — Tss, ug = U — Uss 
results in’ ds 
t = f(t, Tss +25, Uss + Us) = falt, m5, us) 
where fs(t,0,0) = 0 for all ¢ 2 0. For output feedback problems, the output is 
redefined as 
l def 
ys =y- h(t, Tss: Uss) = h(t. Tss + T5. Uss + us) d h(t, Xss, Uss) = hs(t, xs. us) 
in which A;(£, 0, 0) = 0 for all t 2 0. We can now proceed to the solve the standard 


stabilization problem for the system 


folt, 25, us) 
h(t. zs, us) 


£s 
ys 
where ug is designed as feedback control of xg or ys. The overall control u = ug -+ Uss 


bas a feedback component us and a feedforward component uss» 
Naturally, the feedback stabilization problem is much simpler when the system 


is linear and time invariant: 


il 


Az + Bu 
Cz + Du 


i 
y 


In this case, the state feedback control u = — Kz preserves linearity of the open-loop 
system, and the origin of the closed-loop system 


i-(i-BK) 


ree 
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EN is asymptotically stable if and only if the matrix A — BK is Hurwitz. Thus, the equation and exact mathematical cancellation of terms are almost impossible, the, 

r, state feedback stabilization problem reduces to a problem of designing a matrix K implementation of this approach will almost always result in a closed-loop system, 

NC to assign the eigenvalues of A — BK in the open left-half complex plane. Linear which is a perturbation of a nominal system whose origin is exponentially stable. 
The validity of the method draws upon Lyapunov theory for perturbed systems 


& control theory! confirms that the eigenvalues of A — BK can be arbitrarily assigned 
(Chapter 9), specifically regarding robustness of exponential stability. 


5 (subject only to the constraint that complex eigenvalues are in conjugate pairs) 


provided the pair (A,B) is controllable. Even if some eigenvalues of A are not 
controllable, stabilization is still possible, provided the uncontrollable eigenvalues 
have negative real parts. In this case, the pair (A, B) is called stabilizable, and 
the uncontrollable (open-loop) eigenvalues of A will be (closed-loop) eigenvalues of 
A — BK. If we can only measure the output y, we can use dynamic compensation, 
like the observer-based controller 


When a linear system is stabilized by feedback, the origin of the closed-loop 
system is globally asymptotically stable. This is not the case for nonlinear systems 
where different stabilization notions can be introduced. If the nonlinear system is 
stabilized via linearization, then the origin of the closed-loop system will be asymp- 
totically stable. Without further analysis of the system, the region of attraction of 
the origin will be unknown. In this case, we say the feedback control achieves local 


stabilization. If the feedback control guarantees that a certain set is included in the 


E u = -Kĉ region of attraction or if an estimate of the region of attraction is given, we say that 
" & = Aĉ+ Bu+ H(y- Cê -— Du) the feedback control achieves regional stabilization. If the origin of the closed-loop 
5 system is globally asymptotically stable, we say that the control achieves global 
E to stabilize the system. Here, the feedback gain K is designed as in state feedback, stabilization. If feedback control does not achieve global stabilization, but can be 
JA such that A — BK is Hurwitz, while the observer gain H is designed such that designed such that any given compact set (no matter how large) can be included 


in the region of attraction, we say that the feedback control achieves semiglobal 
stabilization. These four stabilization notions are illustrated by the next example. 


El 
"s. 


A — HC is Hurwitz. The closed-loop eigenvalues will consist of the eigenvalues of 
A — BK and the eigenvalues of A — HC.? The stabilization of A — HC is dual to . 


AR) 
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the stabilization of A — BK and requires observability (or at least detectability):of 
the pair (A, C). S 
For a general nonlinear system, the problem is more difficult and less understood. 

The most practical way to approach the stabilization problem for nonlinear systems 

is to appeal to the neat results available in the linear case, that is, via linearization. 

In Section 12.2, a feedback control law is designed by linearizing the system about 

the desired equilibrium point and designing a stabilizing linear feedback control for 

the linearization. The validity of this idea comes from Lyapunov's indirect method 

stated in Theorems 4.7 and 4.13. Clearly, this approach is local; that is, it can 
only guarantee asymptotic stability; but cannot, in general, prescribe a region of 
attraction nor achieve global asymptotic stability. In Section 12.5, we describe gain 
scheduling, a technique that aims at extending the region of validity of linearization 
by solving the stabilization problem at different operating points and allowing the 
controller to move from one design to another in a smooth or abrupt way. . In 
Chapter 13, another linearization idea is presented. There, we deal with a special 
class of nonlinear systems that can be transformed into linear systems via feedback 
and (possibly) a change of variables. After this transformation, a stabilizing linear 
state feedback control is designed for the linear system. This linearization approach 
is different from the first one in that no approximation is used; it is exact. Exactness, 
however; assumes perfect knowledge of the state equation and uses that knowledge 
to cancel the nonlinearities of the system. Since perfect knowledge of the state 


'See, for example, [9], [35), [110], or [158]. 
2This fact is usually referred to as the "separation principle,” since the assignment of the 
closed-loop eigenvalues can be carried out in separate tasks for the state feedback and observer 


Example 12.1 Suppose we want to stabilize the scalar system 
> t=r +u 

by.using state feedback. Linearization at the origin results in the linear system 
$ = u, which can be stabilized by u = —kz with k > 0. When this control is 
&pplied to the nonlinear system, it results in : 


t= -kr +r? 


whose linearization at the origin is ¢ = —Kz. Thus, by Theorem 4.7, the origin 
is asymptotically stable, and we say that u = —kz achieves local stabilization. In 
this example, it is not hard to see that the region of attraction is the set {x < k}. 
With this information, we say that u = —kz achieves regional stabilization. By 
increasing k, we can expand the region of attraction. In fact, given any compact 
set B, = {|z| < r}, we can include it in the region of attraction by choosing k > r. 
Hence, u = —kz achieves semiglobal stabilization. It is important to notice that 

= —kz does not achieve global stabilization. In fact, for any finite k, there is a part 
of the state space (that is, z > k), which is not in the region of attraction. While 
semiglobal stabilization can include any compact set in the region of attraction, 
the control law is dependent on the given set and will not necessarily work with a 
bigger set. For a given r, we can choose k >r. Once k is fixed and the controller is 
implemented, if the initial state happens to be in the region {x > k}, the solution 
z(t) will diverge to infinity. Global stabilization can be achieved by the nonlinear 
control law 

uz -—z-kz 
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which cancels the open-loop nonlinearity and yields the linear closed-loop system 
$--—kmr. AY 


We turn now to the description of a more general control problem; namely, the 
tracking problem in the presence of disturbance. Here, we have a system modeled 


by 


$i = f(t,z,u,w) 
= A(t,z,u,w) 
Ym = Am(t,z,u,w) 


where zr is the state, u is the control input, w is a disturbance input, y is the 
controlled output, and ym is the measured output. The basic goal of the control 
problem is to design the control input so that the controlled output y tracks a 
reference signal r; that is, 


et) = y(t) —r(t) 0, Vt2 to 


where to is the time at which control starts. Since the initial value of y depends on 
the initial state x(to), meeting this requirement for all t > to would require either 
presetting x(to) or presetting the initial value of the reference signal by assuming 
knowledge of z(f9), which is not feasible in many applications. Therefore, we usually 


seek an asymptotic output tracking goal, where the tracking error e approaches zero 
as t tends to infinity; that is, 


e(t) 2 0 as t— oo 


If ásymptotic output tracking is achieved in the presence of input disturbance w, we 
say that we have achieved asymptotic disturbance rejection. When the exogenous 
signals r and w are generated by a known model, such as constant signals or si- 
nusoidal signals of known frequencies, asymptotic output tracking and disturbance 
rejection can be achieved by including such model in the feedback controller.) This 
is so even when the system's model contain uncertain parameters. In the impor- 
tant special case of constant exogenous signals, where the goal is to asymptotically 
regulate y to a "set point" r, asymptotic regulation and disturbance rejection can 
be achieved by including "integral action" in the controller. This is the only way to 
achieve asymptotic regulation in the presence of parametric uncertainties, which ex- 
plains the popularity of PI (proportional-integral) and PID (proportional-integral- 
derivative) controllers in industrial applications. The principle of using integral 
action is not tied in with linearity. This is shown in Section 12.3 where integral 
control is presented for a general nonlinear system; then in Section 12.4, we show 
how linearization can be used to design the stabilizing component of the integral 
controller. In Chapter 14, Sections 14.1.4 and 14.5.3, we show how PI and PID 
controllers can be designed as robust regulators of a class of nonlinear systems. 


This is known as the “internal modol principle.” (See (32).).— 


| 
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For a general time-varying disturbauce input w(t), it might not be feasible to 
achieve asymptotic disturbance rejection. In such cases, we may attempt to achieve 
disturbance attenuation. which can take the form of a requirement to achieve ulti- 
mate boundedness of the tracking error with a prescribed tolerance; that is, 


let) «e. Vtz T 


where e is a prespecified (small) positive number. Alternatively, we may consider 
attenuating the closed-loop input-output map froin the disturbance input w to the 
tracking error e. For example, if we cousider w as an £2 signal, then our goal would 
be to minimize the £2 gain of the closed-loop input-output map from w to e, or at 
least, make this gain less than a prescribed tolerance.* ; 

Feedback control laws for the tracking problem are classified in the same way 
we have seen in the stabilization problem. We speak of state feedback if x can be 
measured; that is, if ym = z; otherwise, we speak of output feedback. Also, the 
feedback control law can be static or dynamic. The control lew may achieve local, 
regional, semiglobal. or global tracking. The new element here is that these phrases 
refer not only to the size of the initial state, but to the size of the exogenous signals 
r and v as well. For example, in a typical problem, local tracking means tracking is 
achieved for sufficiently small initial states and sufficiently small exogenous signals, 
while global tracking means tracking is achieved for any initial state and any (r, w) 
in a prescribed class of exogenous signals. 


12.2 Stabilization via Linearization 


We illustrate the design-via-linearization approach by considering the stabilization 
problem. We start with state feedback control and then present output feedback. 
For state feedback stabilization. consider the system 


£e fu) oy) 


where f(0.0) = 0 and f(z, u) is continuously differentiable in a domain D. x Du c 
R^ x RP that contains the origin (£ = 0, u = 0). We want, to design a state 
feedback control law u = 7(z) to stabilize the system. Linearization of (12.1) about 
(z = 0, u = 0) results in the linear system 


ż = Ax + Bu (12.2) 


where 
E x opua 
p ae” E z=0,u=0 i 


5 . 
This is the formulation of the Hx control problem. (See, for example, [20], [54], [61]. 190] 


[199]. and [219].) 
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Assume the pair (A, B) is controllable, or at least stabilizable. Design a matrix K to 
assign the eigenvalues of A — BK to desired locations in the open left-half complex 
plane. Now apply the linear state feedback control u = —Kz to the nonlinear 
system (12.1). The closed-loop system is 


à-f(n-Kz) . (12.3) 


Clearly, the origin is an equilibrium point of the closed-loop system. The lineariza- 
tion of (12.3) about the origin z = 0 is given by f 


t= Ps, —Kr)+ A (s, - Kz) CE) s -(A—BK)x 


Since A— BK is Hurwitz, it follows from 'Theorem 4.7 that the origin is an asymptot- 
ically stable equilibrium point of the closed-loop system (12.3). Actually, according 
to Theorem 4.13, the origin is exponentially stable. As a byproduct of the lineariza- 
tion approach, we can always find a Lyapunov function for the closed-loop system. 
Let Q be any positive-definite symmetric matrix and solve the Lyapunov equation 


P(A—- BK) - (A- BK) P = -Q 


for P. Since (A — BK) is Hurwitz, the Lyapunov equation has a unique positive 


definite solution (Theorem 4.6). The quadratic function V(x) = 27 Pz is a Lya- | 


punov function for the closed-loop system in the neighborhood of the origin. We 
can use V(x) to estimate the region of attraction. 


Example 12.2 Consider the pendulum equation 

Ë = -asin§ — bÊ + cT 
where a = g/l > 0, b = k/m > 0, c = 1/ml? > 0, 6 is the angle subtended by the 
rod and the vertical axis, and T' is the torque applied to the pendulum. View the 
torque as the control input and suppose we want to stabilize the pendulum at an 


angle 0 = 6. For the pendulum to m intain equilibrium at 0 = ô, the torque must 
have a steady-state component Tss that satisfies 


= —asinó + cT, 


Choose the state variables as z; — g- 6, £2 = Ê and the control variable as 
u =T — Ta. The state equation 

$i] = X 
—a|sin(z; + 6) — sind] — bre + cu 


12 
is in the standard form (12.1), where f(0,0) = 0. Linearization of the system at 
the origin results in 
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The pair (A, B) is controllable. Taking K = [kı ka], it can be easily verified that 
A — BK is Hurwitz for 


k gro. hon? 
c 
The torque is given by 
asinó inó : j 
T= -Kem SS Lk (0 ~ 8) — kab 


We leave it to the reader (Exercise 12.1) to continue with the Lyapunov analysis of 
the closed-loop system. A 


For output feedback stabilization, consider the system 


$ = f(z,u) - (124) 
y = h(x) (12.5) 


where /(0,0) = 0, h(0) = 0, and f(z, v), h(x) are continuously differentiable in a 
domain D, x D, C R” x RP that contains the origin (z = 0, u = 0). We want to 
design an output feedback control law (using only measurements of y) to stabilize 
remm Linearization of (12.4)-(12.5) about (z = 0, u = 0) results in the linear 
system 


t = Ar+Bu (12.6) 
y = Cr (12.7) 
where A and B are defined after (12.2) and 
ðk 
C= a; (2) 


zz 


Assume (A, B) is stabilizable and (A, C) is detectable, and design a li i 
, j d 
output feedback controller j dic: p 


i 


Fz4 Gy - (28) 


u Lz+ My : (12.9) 


such that the closed-loop matrix 


(12.10) 


A-c- BMC BL 
GC F 


is Hurwitz. An example of such design is the observer-based controller, where 


z=, F-A-BK — HOC, G=H, L--K, M=0 
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and K and H are designed such that A— BK and A — HC are Hurwitz. When the 
controller (12.8)-(12.9) is applied to the nonlinear system (12.4)-(12.5), it results 
in the closed-loop system 


f(z, Lz + Afh(z)) 
Fz+Gh(z) 


(12.11) 
(12.12) 


Ne Re 
I 


It can be verified that the origin (x = 0, z = 0) is an equilibrium point of the 
closed-loop system (12.11)-(12.12) and linearization about the origin results in the 
Hurwitz matrix of (12.10). Thus, once again, we conclude that the origin is an 
exponentially stable equilibrium point of the closed-loop system (12.11)-(12.12). A 
Lyapunov function for the closed-loop system can be obtained by solving a Lyapunov 
equation for the Hurwitz matrix of (12.10). l 


Example 12.3 Reconsider the pendulum equation of Example 12.2, and suppose 
we measure the angle 0, but not the angular velocity 6. An output variable y can 
be taken as y = zı = 8 — ô, and the state feedback controller of Example 12.2 can 
be implemented by using the observer 


$= At + Bur H(y - &) 
Taking H = [hy ha3]7, it can be verified that 4 — HC will be Hurwitz if 
hi 4b» 0, hib 4- ha +acosd 5 0 


The torque is given by 
_ asind 


T -KÊ 


12.3 


In Example 12.2, we considered the problem of regulating the pendulum's angle 8 to 
a constant value ô. We reduced the problem to a stabilization problem by shifting 
the desired equilibrium point to the origin. While this approach is sound when 
the parameters of the system are known, it could be unacceptable under parameter 
perturbations, The control law 


Integral Control 


asinó 
c 


— ky (9 — ô) — kof 


T = 


comprises the steady-state component Tas = (a/c) sind, which assigns the equilib- 
rium value of 8, say 4,5, at the desired angle 6, and the feedback component -K g. 
which makes A — BK Hurwitz. While the calculation of both components depends 
on the parameters of the system, the feedback part can be designed to be robust to 
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a wide range of parameter perturbations. In particular, if we know an upper bound 
on the ratio a/c. that is, a/c € p. we can ensure that A — BK will be Hurwitz by 
choosing kı and kp to satisfy 


ki»p ka>0 
The calculation of Tzs, on the other hand. could be sensitive to parameter pertur- 
bations. Suppose Tss is calculated by using nominal values ag and cg of a and c, 
respectively. The equilibrium point of the closed-loop system is given by 

ao. 


asin Oss = [e sirô — kı (855 — 5) 
0 
If ô = 0 or ó = r (that is; the pendulum is stabilized at oue of the open-loop 
equilibrium poiuts), Tss = 0 and the foregoing equation yields 6,, = 5. In this case, 
the approach used iu Example 12.2 will be robust to parameter perturbations. For 
other values of 6, the error in the steady-state angle could be unacceptable. For 
example, if 6 = 45°. c = co/2 (doubling the mass), a = ao, and kı = 3aq/co, we 
have bss ~ 36°. : 

In this section. we present an integral control approach that ensures asymptotic 
regulation under all parameter perturbatious that do not destroy the stability of the 
closed-loop system. ‘The use of integral control is not tied in with linearity nor with 
the use of linearization to design the feedback controller. We preseut the approach 
for a general nonlinear system and theu show in the next section how linearization 
can be used to design the feedback coutroller. i 

Consider the system 


f = f(z,u,w) (12.13) 
y = h(z,w) (12.14) 
Ym = An (z,w) (12.15) 


where z € R” is the state, u € RP is tlic control input, y € RP is the controlled 
output. Ym € R” is the measured output, and w € R' is a vector of unknown 
constant parameters and disturbances. The function f, h. and h, are continously 
differentiable in (z, u) and continuous in w in a domain D; x Dy x D, c R” x RP x Rl. 
Let r € D, C RP be a constant reference that is available on line and set 


v=] 3 | € Di D, x D, 
w 
We want to design feedback control such that 

y(t) +r as t— oo 


We assume that y can be measured: that is, y is a subset of ym. The regulation 
task will be achieved by stabilizing the system at an equilibrium point where y =r. 
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Stabilizing 
Controller 


Figure 12.1: Integral control. 


Towards that end, we assume that for each v € Dy, there is a unique pair (Tss: Uss) 
that depends continuously on v and satisfies the equations 
0 Í (Ess, Usss W) (12.16) 
r = h(a, w) (12.17) 
so that z,, is the desired equilibrium point and uss is the steady-state control that 
is needed to maintain equilibrium at r,s. To introduce integral action, we integrate 
the regulation error e = y — r: 


ize 
Then we augment the integrator with the state equation (12.13) to obtain 
z = f(z,u,w) (12.18) 
à = h(zw)-r : (12.19) 


For multioutput systems (p > 1), the integrator equation represents a stack of 
p integrators where each component of e is integrated. It is clear that integrat- 
ing e requires both y and r to be available on line. The control task now is to 
design a stabilizing feedback controller that stabilizes the augmented state model 
(12.18)-(12.19) at an equilibrium point (Tss, Css) where Tss produces the desired uss- 
Figure 12.1 shows a block diagram representation of the integral control scheme. 

The integral controller comprises two components: the integrator and the sta- 
bilizing controller. The integrator is sometimes called the internal model, since it 
duplicates the model of the equation ù = 0, which generates the exogenous Pai 
signal v. The structure of the stabilizing controller depends on the measured signal. 
For example, in the case of state feedback; that is, when ym = 7, the stabilizing 
controller takes the form 

u = y(z,0,€) 

where y is designed such that there is a unique gss that satisfies the equation 


(Tss, Css: 0) = Uss 
and the closed-loop system 


= f(z, (2,6, h(x, w) x r),w) 


t 
ó = h(z,w)-r 
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has an asymptotically stable equilibrium point at (Tes, Ges). At the equilibrium 
point, y — r, irrespective of the value of w. Hence, asymptotic regulation is achieved 
for all initial states in the region of attraction of (245, vss). f 

The fact that the integral controller of Figure 12.1 is robust to all parameter 
perturbations that do not destroy the stability of the closed-loop system can be 
intuitively explained as follows: The feedback controller creates an asymptotically 
stable equilibrium point. At this point, all signals must be constant. For the 
integrator ¢ = e to have a constant output c, its input e must be zero. Thus, 
the inclusion of the integrator forces the regulation error to be zero at equilibrium. 
Parameter perturbations will change the equilibrium point, but the condition e 0 
at equilibrium will be maintained. Thus, as long as the perturbed equilibrium point 
remains asymptotically stable, regulation will be achieved. 


Tbe design of the stabilizing controller is not a trivial task because the closed-. 


loop equation depends on the unknown vector w. In the next section, we will see a 
straightforward solution to this dilemma via linearization, but it will only guarantee 
local regulation. Nonlocal regulation can be achieved by using some of the nonlinear 
design tools of Chapter 14; an example is given in Section 14.1.4. 


12.4 Integral Control via Linearization 


We start by*designing a state feedback integral controller; then we consider output 
feedback. We need to design u = *(z,c, €) to stabilize the augmented state model 
(12.18)-(12.19) at (Zes, ss) where us = (rss 05s, 0). Since we are going to use 
linearization, it is reasonable to consider a linear feedback control law of the form 


= -Kız = Koo T K3e (12.20) 


When the control (12.20) is applied to (12.18)-(12.19), it results in the closed-loop 
system 

f(z, -K1z — Koo — Ka(h(z,w) — r), w) (12.21) 
h(zw)-r ` (12.22) 


q oH. 
I 


Equilibrium points (Z, 5) of (12.21)-(12.22) satisfy the equations 


0 = f(z,u,w) 
0 = h(z,w)-r 
i= —-Ki$- Kot 


By the assumption that the equilibrium equations (12.16) and (12.17) have a unique 
solution (z,,, usa) in the domain of interest, we conclude that Z = rs, and ŭ = ugg. 
By choosing K2 to be nonsingular, we guarantee that there is a unique solution gss 
of the equation 

Uss = —K1 255 ~ Koes 
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Our task now is to stabilize the equilibrium point (Tss, css). Linearization of the 
closed-loop system (12.21)-(12.22) about (Tss, Oss) yields 


& = (A - BK Es 
where 
=| T7 Tss = A 0 = B 
s 2. A=[ 3 s-|1]. K-[XK K: ] 
E of 8h 
A= az Pew) EN. B= ay 0 uw) , C= a; (0) 
T= U= Uss TETs, U= Usg T—Ta 


The matrices A, B, and C are, in general, dependent on v. Suppose now that (A, B) 
is controllable (respectively, stabilizable) and? 


A B 
rank Ip: 0 E (12.23) 


Then, (A, B) is controllable (respectively, stabilizable).© Desigu X, independent of 
w, such that .A— BK is Hurwitz for all v € D,.7 For any such design, the matrix K3 
will be nonsingular.5 Thus, (Zs, Oss) is an exponentially stable equilibrium point 
of the closed-loop system (12.21)-(12.22), and all solutions starting in its region of 
attraction approach it as £ tends to infinity. Consequently, y(t) - r = 0 as t — ox. 
We note that the stabilization of (Zss, Css) is independent of K3. Therefore. we can 
take K3 = 0, or we may use it as an extra degree of freedom to improve performance. 

In summary, assuming (A, B) is stabilizable and the rank condition (12.23) is 
satisfied, the state feedback control can be taken as 


u = -Kır = Koo 


ó = e=y-r 
where K = [Ky Ko] is designed such that A — BX is Hurwitz. 
Example 12.4 Consider the pendulum equation 


ğ= —asin6 — bó + cT 


uc — X ——— ————À" 

The rank condition (12.23) implies that the linear state model (A, B, C) has no transmission 
zeros at the origin. 

$See Exercise 12.3. 

"This is a robust stabilization problem that has been extensively studied in the linear control 
literature. (See, for example, [48] and (69].) Note that if K is designed to stabilize A — BX at 
some nominal parameters, then, due to continuous dependence of the eigenvalues of a matrix on 
its elements, A ~ BK will remain Hurwitz in some neighborhood of the nominal parameters. 

8Had K2 been singular, A — BK would have been singular as well, which contradicts the fact 
that 4 - BK is Hurwitz. 
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where a = g/l > 0, b = k/m > 0. c = 1/ml? > 0, 0 is the angle subtended by the 
rod and the vertical axis, and T is the torque applied to the pendulum. View T' 
as the control input and suppose we want to regulate Ó to ô. Taking x, = 0 — 6, 
X2- 8, u =T, and y = zi, we write the state equation as 


dj = £2 
ta =  —asin(z, + 6) — brz + cu 
y = on 


It can be easily seen that the desired equilibrium point is 


0 a. 
asl]: Uss = z sind 
The matrices A, B, and C are given by 
0 1 0 
4- | ams eae a=| 2]; c=[1 0] 


Noting that c > 0, it can be easily verified that (A,B) is controllable and the rank 
condition (12.23) is satisfied. Taking Kı = [ky k2] and K3 = k3, it can be verified, 
using the Routh-Hurwitz criterion, that .A — BK will be Hurwitz if 


b+kc>0, (b+ koc)(acosó + kic) — kc 2 0, and kac» 0 


` Suppose we do not know the exact values of the parameters a > 0, b > 0, c > 0, 


but we know upper bounds p, on a/c and p3 on 1/c. Then, the choice 


k 
k2>0, k}>0, and kj» La (12.24) 
2 
ensures that A — BK will be Hurwitz. The feedback control law is given by 
u = -h(8-6)- kaĝ — kso 
ó = 60-5 


which is the classical PID controller. Comparing this feedback law with the one 
derived in Example 12.2 shows that we no longer calculate the steady-state torque 
needed to maintain the equilibrium position. Regulation will be achieved for all 
parameter perturbations that satisfy (b+ koc)(a cos ô + kyc) — kac > 0. Figure 12.2 
shows simulation results for regulating the pendulum to 6 = 7/4 with integral action 
(Example 12.4) and without integral action (Example 12.2). In the first case, the 
feedback gains kı = 8, ko = 2, and k3 = 10 assign the eigenvalues at —15.93, —2.93, 
and —2.14. In the second case, the feedback gains kı = 3, k2 = 0.7 assign the 
eigenvalues at —4 + j4.59. In both cases, the nominal parameters are a = c = 10 
and b = 1. In the perturbed case, b and c are reduced to 0.5 and 5, respectively, 
corresponding to doubling of the mass. The simulation shows the improvement in 
the steady-state response with integral action, which is achieved at the expense of 
a longer settling time aud an increased torque during the trausient period. A 
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Time 


Torque 


Integral action 


0 1 2 3 4 
Time Time 


Figure 12.2: Simulation results for pendulum regulation under nominal (solid) and per- 
turbed (dashed) parameters, with (Example 12.4) and without (Example 12.2) integral 
action. 


In the more general case of output feeback, the integral controller can be taken 
as 


6 = ec-cy-r (12.28) 
= Fz+ Gio + Gym (12.26) 
u = Lz+ Mio + Mym + Mae (12.27) 


where P, Gi, Gz, L, Mj, Ma, and Ms are designed, independent of w, such that 


A4 BM:Cm + BMC BM, BL 
C 0 0 
G2Cm Gi F 


Ac = 


is Hurwitz for all v € D,, where Cm = [Ohm/Oz](xs5,w). This will ensure that 


M L 
Gi F 
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is nonsingular and the equation 


e wee ec. 


has a unique solution (Gss, Zes). Thus, (Tas, Oss) Zas) is the unique equilibrium point 
of the closed-loop system at which u = uss and e = 0. It can be verified that 
A, is the linearization of the closed-loop system about (z45,05s,z,,). Hence, the 
equilibrium point is exponentially stable and all solutions starting in its region of 
attraction approach it as t tends to infinity. Consequently, y(t) - r —^ 0 as t — oo. 


12.5 Gain Scheduling 


The basic limitation of the design-via-linearization approach is the fact that the 
controller is guaranteed to work only in some neighborhood of a single operating 
(equilibrium) point. In this section, we introduce gain scheduling, a technique that 
can extend the validity of the linearization approach to a range of operating points. 
In many situations, it is known how the dynamics of a system change with its 
operating points. It might even be possible to model the system in such a way 
that the operating points are parameterized by one or more variables, which we 
call scheduling variables. In such situations, we may linearize the system at several 
equilibrium points, design a linear feedback controller at each point, and implement 
the resulting family of linear controllers as a single controller whose parameters 
are changed by monitoring the scheduling variables. Such controller is called gain- 
scheduled controller. : l 

The concept of gain scheduling originated in connection with flight control sys- 
tems.? The nonlinear equations of motion of an airplane or a missile are linearized 
about selected operating points that capture the key modes of operation throughout 
the flight envelope. Linear controllers are designed to achieve the desired stability 
and performance requirements for the linearizations about the selected operating 
points. The parameters of the controllers are then interpolated as functions of gain 
scheduling variables; typical variables are dynamic pressure, Mach number, alti- 
tude, and angle of attack. Finally, the gain-scheduled controller is implemented on 
the nonlinear system. We start with a simple example to illustrate the idea of gain 
scheduling. 


Example 12.5 Consider the tank system of Exercise 1.19 where the cross-sectional 
area A varies with height. The system can be modeled by the equation 


h 
sí Ay) a) =w= EF 


9See [159] for a survey of research on gain scheduling and applications to flight control and 


automotive engine control. 
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"EE where h is the liquid height in the tank, wj is the input flow rate, p is the liquid Assuming we know an upper bound on c. we choose kı and kz as 
density, g is the acceleration due to gravity, and k is a positive constant. Taking ^ 
xz = h as the state variable and u = w; as the control input, the state model is given ; kila) = LN kala) = Wn 
by b(a) ` b(a) 
ir: iw rS (u -eyz ES f(z, u) where 0 < Ç < 1, and 2Cw, > |a(a)|. to (approximately) assign the closed-loop 
: eigenvalues at the roots of 
where c = k,/pg will be treated as an uncertain parameter. Suppose we want to : l s? + wns +w? =0 
design a controller such that z tracks a reference signal r. We define y = z as the Thus. the li i mit f the closed-] ' A ; 
controlled output and use r as the scheduling variable. When r = a (a positive ue, the linearization- of the closed-loop system under the fixed-gain contrölleris 
constant), the output y should be regulated to a. To cope with the uncertainty in &=A sla)és +Bjrs, ys — C£; 
c, we use integral control. The equilibrium equations (12.16) and (12.17) take the f 
form where 
O = us — CVTss) Q= Tss i a(a)-2Qw, —w? ew 
= n n: = uU. = 
Hence, Tas = a and uss = c/a. Augmenting the integrator ¢ = e = y —r with the A0 1 0 | p By | -1 | » ad Cy [ t9 ] 
tion, btai i 
state equation, we oran i The closed-loop transfer function from the command input rs to the output ys is 
& = f(z,u) Wwns + w? 
joe qd | | 3+ Boo, — a(o)]s ud 
We use the PI controller ; Now, leaving aside the hypothetical situation where r was assumed to be constant, 
u = —ki(a)e — ka(a)o let us deal with time-varying r. A gain-scheduled PI controller is taken as 
to stabilize the augmented state equation at (Tss, Osa), where dss = —ug/ko(a), 1 d cede : 
=- e — ka(r)o, =e=2-T 
provided k2 # 0. The closed-loop system is given by u(r) Ane ere 
where a is replaced by r so that the gains kj and kg vary directly with r. The 
= f(z-h(a)z-r)- k(a)e) closed-loop nonlinear system under the gain-scheduled controller is 
= r-r 
= f(x,—ky(r)(z — r) — ka(r)o) 
When r = a, the system has an equilibrium point at (255, ss). Linearization of the Be Lap oe 
closed-loop system about (x, 0) = (ss, ss) and r = a yields 
When r = a, the systein has an equilibrium point at (255,03). This shows that 
Jr | a(a) — b(a)kı(a) —b(a)ka(a) l irs | b(a)kı(a) l fs, ys es the closed-loop nonlinear system under the gain-scheduled controller achieves the 
1 0 =I desired operating point for every a. Linearization about (z,c) = (tss; ss) and 
T í r =a yields : 
where £s = [zs os, 2572-0, 05 = 9 — dss, 5 =t — Q, és = A,(a)és+Bala)rs, ys Cs 
8 1 -c A'(x | 
ao) = m a Las (a2) aat- ul vs OE (2)-20. wd 2G (a) 
- z-a,uzcyV/a f-ausrcya aia) — tew. =w . Wn + ta 
a | A,(a) = 15 a 2.0) = | Ai |; C, -[1 0] 
^ .. 9aA(a) : " 
and 4(a) = -b(a)k5(o)os.(a) = A'(a)ev/a/A?*(a). The closed-loop transfer func- 
_ tion from the command input rs to the output ys is 
and 
T 1 TERI ERA 
i Surius. A 82 + [2Cw, — a(o)]s + w2 
ge - E sirka» e mm i 
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Original ; Modified 


Figure 12.3: Modification of the gain-scheduled PI controller of Example 12.5. 


Let us note the difference between the two linear models represented by (Af, Bj, Cp) 
and (A,, Bs, Cs). The first model is the linearization of the closed-loop system under 
the fixed-gain controller, while the second model is the linearization of the closed- 
loop system under the gain-scheduled controller. In both cases, the linearization is 
about the desired operating point. Ideally, we would like these two models to be 
equivalent, for then we know that the local behavior of the closed-loop system near 
the desired operating point matches the behavior predicted by the design model. 
Comparing the two models shows that A, = Ay and C, = Cy, but B, # By, 
resulting in a different zero location in the closed-loop transfer function. Despite 
this difference, the two transfer functions have the same poles and the property 
of zero steady-state regulation error to step inputs. If these are the only design 
objectives, we can say that the gain-scheduled controller is acceptable. On the 
other hand, if other performance issues are of concern, like the transient part of the 
step response, which is affected by the zero location, then we have.to study the effect 


of the zero shift by linear analysis or simulation of the model (As, Bs, Cs) (or both). _ 


Alternatively, we may modify the gain-scheduled controller with the objective of 
arriving at a linear model that is equivalent to (Ay, Bj, Cf) for every a. This can 
be achieved by modifying the gain-scheduled controller to!® 


u--kh(ret« j= —kal(rje 


For constant gain kz, the modification can be interpreted as commuting the gain 
—kz with the integrator. (See Figule 12.3.) The closed-loop nonlinear system under 
the modified gain-scheduled controller is 


& = f(z-kh(r)(z-r)-m) 

9 = -k(r)s-r) 
When r = a, the system has an equilibrium point at £ = £s and N = usa. Lin- 
earization about (z,7) = (zs, Uss) and r = a yields 


Z5 Áms(a)z5 + Bus(o)rs, ys = Cmsz5 
where 


Ama(a) = | NOE oe | i Bmsla) = | Ey | ! Cms = [ 10 ] 


10This modification is the velocity algorithm of [96]. Another modification is given in [114]. 
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z5.7 [25 Du and 75 = N — tgs. The derivative kj does not appear in this model 
because kg is a multiple of e, which vanishes at the equilibrium point. It can be 
easily seen that the models (As, Br, Cs) and (Ams, Bms, Cms) are equivalent by the 
similarity transformation 


&= 1 0 
5710 ~b(a)/w2 |78 
Hence, both models have the same transfer function from rj to ys. : A 


In view of this example, we can describe the development of a gain-scheduled 
tracking controller for nonlinear systems by the following steps: 


1. Linearize the nonlinear model about a family of operating (equilibrium) points, 


parameterized by the scheduling variables. 


2. Using linearization, design a parameterized family of linear controllers. to 
achieve the specified performance at each operating point. 


3. Construct a gain-scheduled controller such that 


e for each constant value of the exogenous input, the closed-loop system 
under the gain-scheduled controller has the same equilibrium point as 
the closed-loop system under the fixed-gain controller; 


e the linearization of the closed-loop system under the gain-scheduled con- i 


troller is equivalent to the linearization of the closed-loop system under 
the fixed-gain controller. ` i 


4. Check the nonlocal performance of the gain-scheduled controller by simulating 
the nonlinear closed-loop model. 


The second step can be achieved by solving the design problem for a family of 
linear models that depend continuously on. the scheduling variables, as we have 
done in the foregoing example, or by solving the problem only at a finite number of 
operating points by using the same controller structure for all of them, but allowing 
the controller parameters to change from one operating point to another. Then, the 
controller parameters are interpolated &t intermediate operating points to produce 
the parameterized family of linear controllers. This interpolation process is usually 
ad hoc in nature and relies on physical insight, !? In the forthcoming development 
we limit ourselves to the case where the design problem is solved for a family of 
linear models that depend continuously on the scheduling variables. 


Consider the system 
£ = f(z,u,v,w) (12.28) 
y = hí(z,w)- (12.29) 
Ym = 


hm(z, w) 200, 280) 


Sae DECRE di 
!18ee [159] for further discussion of this interpolation process. 
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where f, h, and Am are twice continuously differentiable functions in (x, u,v) and 
continuous in w in a domain D, x Dy x D, x Dy C R^ x RP x RY x Rl. Here, x is 
the state, u is the control input, v is a measured exogenous input, w is a vector of 
unknown constant parameters and disturbances, y € RP is the controlled output, 
and Ym € R™ is the measured output. We assume that y can be measured; that is, 
y is a subset of ym. Let r € D, C RP be a reference signal. We want to design an 
output feedback controller that achieves small tracking error e = y — r in response 
to the exogenous input 


p=| ; Jen, De x Ds 


We use integral control to achieve.zero steady-state error when v — o (a constant 
vector) and rely on gain scheduling to achieve small error for slowly varying p. We 
partition a as a = [o7, oT]T, where a, and a, are constant values for r and 
v, respectively. We use p as the scheduling variable.!? For the design of integral 
control we assume that there is a unique pair (ss, ss) : Dp X Du — Dz x Dy, 
continuously differentiable in a and continuous in w, such that 


0 = f(zs(o, w), us (o, w), av, w) (12.31) 
h(Tss(&, w), w) (12.32) 


Qr 


ll 


for all (a, w) € D, x Dy. When p = o, we can use linearization, as in the previous 
section, to design an integral controller of the form 


Ó = e=y-r (12.33) 
ż = F(a) + G,(a)o + Go(a)ym (12.34) 
u = La)z+My(a)o + Mo(a)ym + Ms(a)e (12.35) 


where the controller gains F, Gi, G2, L, Mi, Mo, and M; are continuously differ- 
entiable functions of a, designed such that 


A+ BMoCm+ BARC BM, BL 


Acla w) = C 0 0 
GoCn Gi F 


is Hurwitz for all (a, w) € D, x Dy, where 


LO cau inue NS 
Amp Baggy Cag ond Ce, 


—_—_—_— 
121n the gain scheduling literature, the scheduling variable is also allowed to depend on the 


messed ont put is. (See [159]. 
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with all Jacobian matrices evaluated at (x, u,v) = (Tss, Uss, @y). The new element 
here is allowing the controller gains to depend on o (the frozen value of the schedul- 
ing variable p). In the state feedback case, we can drop z and its state equation 
(12.34) and take Ym = 3, L = 0, Mi = —Ko, Ma = —Ky, and M3 = 0, where 
K = [K, K3] is designed such that 


A-BK, -BK» 
C 0 


is Hurwitz for every (a, w) € D, x Dw. 
The closed-loop system under tlie fixed-gain controller (12.33)-(12.35) is 


è = f(z,Le+ My + Mzhm(z,w) + Ase, v, w) ` (12.36) 
¢ = e = h(zr,w)=r (12.37) 
i Fz + Gio + Gh, (x, w) (12.38) 
y = h(r,w) (12.39) 


When p = a, the system has an equilibrium point at (zss, ass: Zss) at which e = 0. 
Linearization about (x, 0,2) = (Tss: Oss: 2,,) and p = a yields 


: és = Ay(a,w)és + By(a,w)ps (12.40) 
ys = Cyla.wés (12.41) 
where 
T — Tss r 
Es = | 0 = Oss Ps = p— -| ar Ys = y-a 
Z — Zss d i 
-BM, E 
Ap=A,, Bpzm -I 0 |, Cy=[C 0 0] 
0 0 
of 
= -> (x,u, v, w) 
Ov TT—IQ.agUTUasQUTO, 


Hence, when p = o, the equilibrium point (Tss, Css, Zas) is exponentially stable. 

A gain-scheduled controller can be obtained from the fixed-gain controller (12.33)- 
(12.35) by scheduling the gains F, G1. G2 L, Mi, M2, and M3 as functions of the 
scheduling variable p, that is, replacing a by p. It can be verified that the closed- 
loop system under this controller will have the desired equilibrium point aud its 
linearization (A,(a, w), B,(a,w),C,(a,w)) will have A, = Ay = Ac C, = Cy, 
but, in general, B, 4 By due to partial differentiation of the scheduled gains with 
respect to p. The fact that A.(a,w) is Hurwitz for all (a,w) € D, x Dy shows 
that the gain-scheduled controller will produce an exponentially stable equilibrium 
point with zero steady-state tracking error when p = a. However. the closed-loop 
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transfer function from ps to ys could be different from the corresponding transfer 
function of the design model. Therefore, we must check the local performance of 
the gain-scheduled controller via analysis or simulation. If the performance is ac- 
ceptable, we may go ahead and implement the gain-scheduled controller. It turns 
out, however, that we can do better than that. As in Example 12.5, we can modify 
the gain-scheduled controller to achieve equivalence between the linearized models 
of the closed-loop systems under the fixed-gain and gain-scheduled controllers. In 
the example, we commuted the gain k and the integrator; that is, we moved the 
integrator from the input side of the controller to its output side, so that both gains 
kı and kz are multiples of e, which vanishes at steady-state. This is basically what 
we would like to do for the controller (12.33)-(12.35). However, the current situa- 


' tion is complicated by the presence of the dynamic equation (12.34), which has two 


driving inputs: o and ym- While ø is the output of an integrator and it makes sense 
to talk about moving the integrator to the output side of the controller, ym is not 
the output of an integrator. This difficulty can be overcome if we can measure Ym, 
the derivative of ym. For, then, we can represent the controller (12.33)-(12.35) as 
i=% 
i = F(o)z t G(a)A 
u = L(a)z+ M(a)À + Ma(o)e 
where 
£g] G=[G G;], ad M-[M ,M;] 
The transfer function from v to u, 


(Lo)leI - F(a)|-*(a) 4-M(a)) 


is equivalent to 


HELSI — F(a)]* G(o)  M(a)) 


Hence, the controller can be realized by 


$ = F(o)e*G(o) — 
ñ = L(o)e*M(o)b 
u = n+ Ms(o)e 


Figure 12.4 shows the original and modified realizations of the fixed-gain controller. 
Scheduling the gains F, G, L, M, and Mg in the modified realization as functions 
of the scheduling variable p, we obtain the gain-scheduled controller 


$ = F(p)p+Gi(p)e + Ga(o)jm (12.42) 
4 = L(pye- My(p)e  Ma(p)tm. (1243) 
u = n+ Ms(p)e (12.44) 
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When this controller is applied to the nonlinear system (12.28)-(12.30), it results” 


in the closed-loop system 


* = g(Xpw) (1245). 
y = h(z,w) (1246) - 
where 
| z | | f(z,n + Ms(p)e, v, w) : 
=| p |, g, pw)=]| Flojo + Gilpje + Gi(p)jm 
7 L(p)ip + Mi(o)e + Mo(p) tm | 


; Oh 
ezh(z,w)-r, ým= pu w)f(z,n + Ms(p)e, v, w) 
When p = o, the system (12.45)-(12.46) has a unique equilibrium point 


Tesla, w) 
Xss la, w) = 0 (12.47) 
Uss (a, w) : f 
at which y = a,. Linearization of (12.45)-(12.46) about X = AX, and p = a yields!3 
m as = Ama(a, w)¥5 + Bins(a, w) ps (12.48) 
¥ = 


Cms(a, w) 5 (12.49) 
where » 


At BMC -0 B' 
Xs =R — Xa Amo ] GIC G2Cm(A + BM3C) F GCmB 
MiC + M2C,,(A+BM;C) L M;CA4B 


-BM3 E 

Bnr = -G;- G2CmBM3 G2CmE > Cme = [ c 00 ] 
-Mi ~ M2CnBM3 MeC,E ` 

We leave it as an exercise for the reader (Exercise 12.6) to verify that the matrix 


I 0 0 
P=| GC, Gu F 12.50 
MoCn Mj L 

is nonsingular and 
P~! AmsP = A;, PB. By, and C,,P= C; (12.51) 


ym the linear model (12.48)-(12.49) is equivalent to the linear model (12.40) 


————————— 
13 While calculatin i 
g the matrices Ams and Bms, note that partial derivatives that 
coefficients of p, e, or f vanish at the operating point. SETS 
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Modified 


Figure 12.4: Modification of the gain-scheduled controller. 


a ae Mens bug ee systein under the gain-scheduled controller 
n the local behavior in the neighborhood of a c i 
à onstant operatin 
san em we i more about the behavior of the nonlinear system? What if ile 
g variable is not constant? In applications of gai js 
?1 gain scheduling, the practice 
has been that you can-schedule on time-varying variables as long as they iré slow 


enough relative to the dynamics of the system. This practice is justified by 


theorem. the next 


Theorem 12.1 Consider the closed-loop system (12.45)-(12.46) under the stated 
Ni men Suppose p(t) is continuously differentiable, p(t) € S (a compact subset 
e Ga ici It S A for allt > 0. Then, there exist positive constants k, kz 

; such that if u < ky and [A (0) ~ Xs5(0(0), w) |] < ka, then X(t) will be 


uniformly bounded for all t > 0 and 
lel Sk, Vt>r 
Furthermore, if p(t) — p, and p(t) > 0 as t — 00, then 


e(t) +0 as t— oo 


Proof: See Appendix C.19. 
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The theorem shows that if the scheduling variable is slowly varying and the 
initial state is sufficiently close to the equilibrium point at the initial time, then the 
tracking error will, eventually, be of the order of the derivative of the scheduling 
variable and will tend to zero if the scheduling variable approaches a constant limit. 

If measurement of ğm is not available. we can use the gain-scheduled controller 


$ = F(pe- (9e Go(o)? (12.52) 
à = Lloje Moy * Ma(o)8 (12.53) 
u = m4 Ms(p)e (12.54) 


where Ym is replaced by its estimate 2. provided by the filter 
eC = —C+Ym (12.58) 
1 
9 = z(= + Ym) (12.56) 


where ¢ is a “sufficiently small" positive constant and the filter is always initiated 
at C(0) such that f 
IC(0} — y. (0)]] < ke (12.57) 
for some k > 0. Since ym is measured, we can always meet this initial condition. 
Furthermore, whenever the system is initited from an equilibrium point, tlie con- 
dition (12.57) is automatically satisfied, since, at equilibrium, ym = Ç. The filter 
(12.55)-(12.56) acts as a derivative approximator when e is sufficiently small, as it 
can be seen from its transfer function 
8 
I 
es+1 


which approximates the differentiator transfer function s/ for frequencies much 
smaller than 1/e.!4 The closed-loop system under the gain-scheduled controller 
(12.52)-(12.56) takes the singularly perturbed form 


X = g(X.p.w) + N(o)(9 — Ym) (12.58) 
de eggs (12.59) 
y = h(x,w) (12.60) 
where 
ah : 
Ym = —— (z, w) f(z, n+ Msx(g)e,vw, N= G2 
Ox : M; 


M Approximating the derivative ým can be achieved by using the high-gain observer of Sec- 
tion 14.5. In fact, the filter (12.55)-(12.56) is a reduced-order high-gain observer for a second-order 
system whose output is ym. The condition (12.57) eliminates peaking of the transient response. 
If this condition cannot be enforced, the estimate 9 should be saturated to eliminate peaking, as 
discussed ín Section 14.5. 
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and the system (12.58)-(12.60) reduces to the system 


Setting e = 0 results in 9 = jm (12.55)-(12.56) for 


(12.45)-(12.46). The next theorem justifies the use of the filter 
sufficiently small £. 

Theorem 12.2 Consider the closed-loop system (12.58)-(12.60) under the stated 
assumptions. Suppose p(t) is continuously differentiable, p(t) € S (a compact subset 
of Dp), and \\a(t)|| S e for allt > 0. Then, there exist positive constants ki, ke, k3, 
k, and T such that if u < kı, |æ (0) — Xzs(p(0), w) || < ko, ande < ks, then X(t) 
will be uniformly bounded for all t > 0 and 


le) sku VtzT 


Furthermore, if p(t) — pss and p(t) + 0 as t — co, then 


e(t) — 0 as t— co 


Proof: See Appendix C.20. 


The theorem shows that if the scheduling variable is slowly varying, the ini- 
tial state is sufficiently close to the equilibrium point at the initial time, and & is 
sufficiently small, then the tracking error will, eventually, be of the order of the 
derivative of the scheduling variable and will tend to zero if the scheduling variable 


approaches a constant limit. 


4 


Example 12.6 Consider the second-order system 


ij = tanzj-d ro 
i2 = zitu 
Oy = om 


where y is the only measured signal; that is, ym = y. We want y to track a 
reference signal r. We use r as the scheduling variable. When r — a — constant, 
the equilibrium equations (12.31) and (12.32) have the unique solution 


za (o) = | eme B | , usla) = tan"! a 


We use the observer-based integral controller 


ó = e=y-T (12.61) 
à = A(a)é+ But H(o)(y - C£) (12.62) 
u = -Ki(a)t- Ko(a)o (12.63) 


where at)» [159 i]. a-|1]. c=[0 1] 


t —M cipe arn ai qui 
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s a 


l i 
Ki(o) = [ (1+a)(3 +a?) +3 + pha 34 o? ], Ki(o) = - iL 


H(a)= | 10+ as +a?) | 


The feedback gains K, (a) and K2(a) are designed to assign the closed-loop eigen- 
values at —1, —(1/2) + 3(V3/2). The observer gain H (a) is designed to assign the 
observer eigenvalues at —(3/2) + j(3/3/2). We have chosen the eigenvalues inde- 
pendent of a for convenience, but we could have allowed them to depend on aas 
long as their real parts are less than a negative number independent of a. This fixed- 
gain controller is a special case of (12.33)-(12.35) with z = ĉ, F = A- BK, ~ HC, 
Gı = -BK3, G; = H, L = -Ki, Mi = —Ks, M: = 0, and M; = 0. Since j 
is not available, we implement the gain-scheduled controller (12.52)-(12.56) with 
€ = 0.01. Figure 12.5 shows the response of the closed-loop system to a sequence . 
of step changes in the reference signal. A step change in the reference signal resets 
the equilibrium point of the system, and the initial state of the system at time 
04 is the equilibrium state at time 0... If the initial state is within the region of 
attraction of the new equilibrium point, the system reaches steady state at that 
point. Since our controller is based on linearization, it guarantees only local stabi- 
lization. Therefore, in general, step changes in the reference signal-will have to be 
limited. Reaching a large value of the reference signal can be done by a sequence of 
step changesy.as in the figure, allowing enough time for the system to settle down 
after each step change. Another method to change the reference set point is to 


0.8 


o 
e 


0 20 40 60 . 80 100 120 140 
Time 


Figure 12.5: The reference (dashed) and output (solid) signals of the gain-scheduled 
controller of Example 12.6. 


move slowly from one set point to another. Figure 12.6 shows the response of the 
closed-loop system to a slow ramp that takes the set point from zero to one over a 
period of 100 seconds. This response is consistent with our conclusions about the 
behavior of gain-scheduled controllers under slowly varying scheduling variables. 
The same figure shows the response to a faster ramp signal. As the slope of the 
ramp increases, tracking performance deteriorates. If we keep increasing the slope 
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0 20 40 60 80 
Time 


120 140 
40 60 80 100 
100 120 0 20 


Time 
Figure 12.6: The reference (dashed) and output (solid) signals of the gain-scheduled 


controller of Example 12.6 with ramp reference: (a) ramp slope — 0.01; (b) ramp slope 
-0. 


Figure 12.8: The reference (dashed) and output (solid) signals of the unmodified gain- 
scheduled controller of Example 12.6. 


| take the state of the system out of the finite region of attraction, although instability 


A 
of the ramp, the system will eventually go unstable. To appreciate what we gain was not observed in this example. l 


by gain scheduling, Figure 12.7 shows the response of the closed-loop system to the 
same sequence of step changes of Figure 12.5 when a fixed-gain controller evaluated 
at a = 0 is used. For small reference inputs, the response is as good as the one with 
the gain-scheduled controller, but as the refereuce sigual increases, the performance 
deteriorates and the system goes unstable. Finally, to see why we may have to mod- 


12.6 Exercises 


i Y ox 122. Assume a = c = 10, 
ider the closed-loop system of Exainple 
= "act ky = 2.5, and ko = 1. Find a Lyapunov function for the system, 
= 7/4, cM Le Mert ; * 
and use it to estimate the region of attraction. 


0.8 12.2 For each of the following systems. use linearization to 
on (a) design a state feedback controller to stabilize the origiu. 
0.4 c side 
02 (b) design an output feedback controller to stabilize the origin. 
0 
-0.2 d = Ty 4 22 
0 10 20 30 40 50 60 70 (1) ij = 3x TzrictUu 
Time y = -23 + T2 
Figure 12.7: The reference (dashed) and output (solid) signals of the fixed gain con- t )1—7 mn d is 
troller of Example 12.6. 2) dg = 10g 7011 93 
( i3 = u " 
y ify the gain-scheduled controller as in Figure 12.4, Figure 12.8 shows the response y cc + 22 
of the closed-loop system under an unmodified controller (obtained by simply re- ij = -ntZ 
j placing o by r in the foregoing controller equations) to the same sequence of step dg = ry- T- TiTa 
changes of Figure 12.5. While stability and zero steady-state tracking error are (3) ij = T, +T1127 223 
achieved, as predicted by our analysis, the transient response deteriorates rapidly yoru u 
as the reference signal increases. This is due to additional zeros in the closed-loop 
transfer function. Such bad transient behavior could lend to iustability as it could 
z " 4 
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12.3 Let » P 
0 

[4 s] -L8 

where A, B, and C satisfy the rank condition (12.23). Show that (A, B) is control- 

lable (respectively, stabilizable) if and only if (A, B) is controllable (respectively, 


stabilizable) 


12.4 Consider the pendulum of Example 12.2. 


(a) Assuming that you measure @, but not 6, design, using linearization, an output 
feedback integral controller to stabilize the pendulum at an angle 8 26. 


(b) Assuming that you measure both @ and 6, design a gain-scheduled, state feed- 
back, integral controller so that the angle @ tracks a reference angle 6,. Study 
the performance of the gain-scheduled controller by computer simulation. 


(c) Assuming that you measure @, but not 6, design a gain-scheduled, observer- 
based, integral controller so that the angle @ tracks a reference angle 6,. Study 
the performance of the gain-scheduled controller by computer simulation. 

Use the following numerical data: a = 10, b = 0.1, and c = 10. 

12.5 Consider the linear system 


a= A(o)r-- B(a)u 


where A(a) and B(a) are continuously differentiable functions of the constant vector 
a and a € T, a compact subset of R^. Let W(o) be the controllability Gramian, 
defined by 


W(a)= i ex[-Ate)elB(o)5 (o exp[- 47 (a)o] do 


for some 7 > 0, independent of a. Suppose (A, B) is controllable, uniformly in a, 
in the sense that there are positive constants cı and c, independent of œ, such that 


al €W(o) csl, Yacer 
Let 


Q(a) = A e727 exp[- A(a)o|B(o) B" (a) exp[-A7(a)o] de, c»0 


(a) Show that 
ee "I< Q(a)< aI, Yacer 


12.6. EXERCISES 
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(b) Let 
u= -K(a)z 8€ -1BT (a)P(a)z 


where P(a) = Q~} (a). Using V = z^ P(o)z as a Lyapunov function candi- 
date for 
t = [A(a) - B(a)K(o)]x 


show that V < —2cV. ? 
(c) Show that [A(a) — B(o)K (a)] is Hurwitz uniformly in a for all a eT. 
12.6 Show that P(a), defined by (12.50), is nonsingular and satisfies (12.51). 
12.7 A simplified model of the low-frequency motion of a ship is given by [60] 
T) + = kô 


where 7 is the heading angle of the ship and 6 is the rudder angle, viewed here as 
the control input. The time constant 7 and the gain k depend on the forward speed 
of the ship v, according to the expressions 7 = Tovo/v and k = kov/vo, where To, 
ko, and vg are constants. 


(a) Assuming & constant forward speed, design a state feedback integral controller 
so that % tracks a desired angle pr. 


(b) Use gain scheduling to compensate for varying forward speed. 


12.8 The magnetic suspension system of Exercise 1.18 is modeled by 


di = Io 
: Loax? 
X = — — T) — —— 
: 9 m 2m(a + 21)? 
: 1 Loar2z3 
i3 = ——l- dq ——L——— 
| 7 Te) "Gta 


where z) = y, z2 = j, r3 = i, and u = v. Use the following numerical data: 
m = 0.1 kg, k = 0.001 N/m/sec, g = 9.81 m/sec”, a = 0.05 m, Lo = 0.01 H, 
Lı = 0.02 H, and R=1 Q. 


(a) Find the steady-state values I,, and V4, of i and v, respectively, which are 
needed to balance the ball at a desired position y =r > 0. 


(b) Show that the equilibrium point obtained by taking u = V4, is unstable. 


(c) Using linearization, design a state feedback control law to stabilize the ball at 
y = 0.05 m. 
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(d) pend bad luere ae of y is 0 to 0.1 m and the permissible range of the 
e is 0 to . Starting with the ball at equilibri i 
distance up (and then down) i Lee Ad 
and let it go. Repeat this experi 
periment, graduall 
increasing the amount of initial disturbance. Usi i ‘ 
nt of ini a. Using simulation, determi 

the b range of initial disturbance for which the ball will return to the 
a 3 rium point without violating the constraints on y and v. To account 
or the constraint on v, include a limiter in your simulation. 


(e) Using simulation, investigate the effect of perturbations in the mass m. Sim-. 


ulate the closed-loop syste:n with the i 

t syste: nominal controller, but with the mass 
peeps from its nominal value. Find the range of m for which the controller 
will still balance the ball and investigate the steady-state error. 


(£) ghee = design of part (c) using integral control. Repeat parts (d) and (e) 
or this design. Comment on the effect of integral control on the transient 
response and steady-state error. 


(g) Repeat the design of part (c) assumi ! 
suming you can only m A 
(d) and (e) for this design. Poet d 


(h) Repeat the design of i 
part (c) assuming you can only measu i 
parts (d) and (e) for this design. : NUR, 


(i) Repeat the integral control desi i 
t gn of part (f) assuming you can only ; 
y. Repeat parts (d) and (e) for this design. eo 


(j) Repeat the integral control desi i 
t gn of part (f) assuming you can onl 
and i. Repeat parts (d) and (e) for this design. i did 


k Li : e f 5 . 
(k) so a gain-scheduled, observer-based, integral controller so that the ball 
$ sition y dns a reference position r. Assume you can measure y and i 
sing simulation, study the performance of the gain-scheduled i ben 
r changes slowly from 0.03 to 0.07. i SESE 


(1) EU e is grs i, can you design a linear output feedback control law 
ilize the ball at y =r? C i i :dback i 
D em y an you design a linear output feedback integral 


12.9 A field-controlled DC motor is described in Exercise 1.17. When the field 
circuit is driven by a current source, we can view the field current as the control 
input and model the system by the second-order state model 


a, = —O,r, — 0222u + 03 
$2 —0422 + 0521u 
Y = Po 


EPEE RE HUI tr HORE mte (Boe iye coh i le PIU: s CONS ORR NE NIC CEN SAO INR NS LEMS AA URES NE LONE NR LEN le IG G z 
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where z, is the armature current, 12 is the speed, u is the field current, and @; 
to 0g are positive constants. It is required to design a speed control system su 
that y asymptotically tracks a constant speed reference r. It is assumed that 1? < 
0203/4010204 aud the domain of operation is restricted to z1 > 03/201. 


(a) Find the steady-state input uss needed to maintain the output r. Verify that 
that the open-loop control u = Uss results in an exponentially stable equilib- 


rium point. 

(b) Starting with the motor at rest (y = 0). apply a small step change in the 
reference signal and simulate the response. Repeat this experiment, gradually 
increasing the amount of step change. Determine the largest range of initial 
step for which the motor will reach steady-state at the desired speed. 


(c) Using computer simulation, study the performance of the system when the 
rotor inertia changes by +50%. 


(d) Using linearization, design a state fecdback integral controller to achieve the 
desired speed regulation. Repeat parts (b) and (c) for this controller and 
compare its performance with the open-loop controller of part (a). 


(e) Suppose you measure the speed x2, but not the armature current x). Repeat 
part (d)'by using an observer to estimate tlie armature current. Repeat parts 
(b) and (c) for this controller and compare its performance with the one 
designed in part (d). 

(f) Design a gain-scheduled, observer-based. integral controller so that the speed 
£2 tracks a reference speed r 


In parts (b) through (e), use the following numerical data: 6, = 60, 62 = 0.5, 
0, = 40, 0, = 6, and 65 = 4 x 10*. 


12.10 Consider the inverted pendulum of Exercise 1.15. 
(a) Using T1 = 0. 12 = Å, z3 = y, and ty = jj as state variables and u = F as 
control input. write down the state equation. 


(b) Show that the open-loop system has an equilibrium set. 

(c) Suppose we want to stabilize the pendulwn at the vertical position (@ = 0). 
Find an open-loop equilibrium point at which @ =-0, and show that it is 
unstable. 

(d) Linearize the nonlinear state equation at the desired equilibrium point, and 
verify that the linearized state equation is controllable. 

(e) Using linearization, design a state feedback control law to stabilize the system 

at the desired equilibrium point. l 
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(f) Using computer simulation, study the transient behavior and the effect of +20% 
perturbation in the mass of the pendulum and its moment of inertia. 


(g) Starting with the pendulum at equilibrium, move it a small angle to the right 
(and then to the left) and let it go. Repeat this experiment, gradually increas- 
ing the amount of initial disturbance. Using simulation, determine the largest 
range of initial disturbance for which the pendulum will return to equilibrium. 


(h) Suppose you can only measure the angle 0 and the cart position y. Using 
linearization, design an output feedback controller to stabilize the pendulum 
at 0 = 0. Repeat parts (f) and (g) for this controller. 


(i) Repeat part (h) if it is desired to stabilize the Benin at an angle 0 = 6,, 
where —7/2 < b, < 1/2. 


In parts (e) to (i), use the following numerical data: m = 0.1 kg, M = 1 kg, 
k = 0.1 N/m/sec, {£ = 0.025/3 kg m?, g = 9.81 m/sec?, and L = 0.5 m. 


Chapter 13 Resumen - 


| S]S0- Feedback Linearization 


We consider a class of nonlinear systems of the form 
i f(x) + G(z)u 
y A(x) 
and pose the question of whether there exist a state feedback control 


u = a(z) + B(z)v 


and a change of variables 
z=T(z) 


that transform the nonlinear system into an equivalent linear system. In Sec- 


tion 13.1, we motivate the idea by simple examples and introduce the notions . 
. Of full-state linearization, where the state equation is completely linearized, and . 
input-output ‘linearization, -where the input-output map is linearized,’ “while the . 


state equation. may-be only partially. linearized. ` In Section 13. 2, we study input- 
output linearization, introducing the notions of relative degree, zero dynamics, and 
minimum phase systems. In Section 13.3, we characterize the class of nonlinear 
systems that can be feedback linearized. To simplify the presentation, Sections 13.2 
and 13.3 deal only with single-input-single-output systems. State feedback control 
of feedback (or partially feedback) linearizable systems is discussed in Section 13. 4, 

where we deal with both stabilization and tracking. 


13.1 Motivation 


To introduce the idea of feedback linearization, let us start with the problem of 
stabilizing the origin of the pendulum equation 
zy = T2 


$2 —a|[sin(zi + 5) — sind] — bre + cu 


$05 


m S o E SH atcke 


OM misc 


906 


Inspection of the state equation shows that we can choose u as 
a,. ; v 
u= C t 6) — sinô] + s 


to cancel the nonlinear term a[sin(x; + ô) — sind]. This cancellation results in the 
linear system 


$1 = 2 
i2 —br2-4v 


Thus, the stabilization problem for the nonlinear system has been reduced to a 
stabilization problem for a controllable linear system. We can proceed to design a 
stabilizing linear state feedback control 


v = kx kam 


to locate the eigenvalues of the closed-loop system E 
ii = r9 : 
to = -kzı - (ka + b)z2 


in the open left-half plane. The overall state feedback control law is given by 
ay,. : 1 
u= (=) [sin(zı + ô) — sind] - MULT + kaz32) 


How general is this idea of nonlinearity cancellation? Clearly, we should not 
expect to be able to cancel nonlinearities in every nonlinear system. There must be a 
certain structural property of the system that allows us to perform such cancellation. 
It is not hard to see that to cancel a nonlinear term a(z) by subtraction, the control 
v and the nonlinearity a(z) must always appear together as a sum u + a(z). To 


cancel a nonlinear term +(x) by division, the control u and the nonlinearity y(x) - 


must always appear as a product *(z)u. If the matrix 4(z) is nonsingular in the 
domain of interest, then it can be cancelled by u = f(z)v, where B(x) = ^ !(x) 
is the inverse of the matrix +(x). Therefore, the ability to use feedback to convert 
a nonlinear state equation into a controllable linear state equation by cancelling 
nonlinearities requires the nonlinear state equation to have the structure 

i= Axr + By(z)[u — a(z)] (13.1) 
where A is nxn, B is nxp, the pair (A, B) is controllable, the functions a : R” — RP 
and y : R” — RP*? are defined in a domain D C R^ that contains the origin. and 
the matrix y(x) is nonsingular for every x € D. If the state equation takes the form 
(13.1), then we cau linearize it via the state feedback 


u z a(r) + rv (13.2) 


CHAPTER 13. FEEDBACK LINEARIZATION 


rí) 
13.1. MOTIVATION 50 


where @(z) = y7} (x). to obtain the linear state equation 


+= Ár + Bv (13.3) 
For stabilization, we design v = —Kz such that A — BK is Hurwitz. The overall 
nonlinear stabilizing state feedback control is 

u = a(x) — 3(x)x (13.4) 


Suppose the nonlinear state equation does not have the structure of (13.1). Does 
this mean we cannot linearize the system via feedback? The answer is no. Recall 
that the state model of a system is not unique. It depends on the choice of the state 
variables. Even if the state equation does not have the structure of (13.1) for one 
choice of state variables, it might do so for another choice. Consider, for example, 
the system . 


asin x2 


i 
; 2 
tq = -titu 


We cannot simply choose u to cancel the nonlinear term asin 12. However, if we 
first change the variables by the transformation 


4 = Uu 


22 asinzg = 2) 


M 


then =; and zs satisfy 


à = 22 
acosz? (—2 +u) 


^ 


42 


M 


and the nonlinearities can be cancelled by the control 


1 
u-ric v 
acos 22 


which is well defined for -7/2 < x} < 1/2. The state equation in the new coor- 
dinates (21, 22) can be found by inverting the transformation to express (11,22) in 
terms of (21,22); that is, 


Ty = 2) 

aata 

sin”! (2) 
a 


which is well defined for ~a < z2 < a. The transformed state equation is given by 


I2 = 


21 = “2 


acos (sin? (3) (722 +u) 


a 
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When a change of variables z = T(z) is used to transform the state equation 
from the z-coordinates to the z-coordinates, the map T must be invertible; that 
is, it must have an inverse map T^ !(-) such that z = T-1(z) for all z € T(D), 
where D is the domain of T. Moreover, because the derivatives of z and z should 
be continuous, we require both T(-) and T~1(-) to be continuously differentiable. A 
continuously differentiable map with a continuously differentiable inverse is known 
as a diffeomorphism. If the Jacobian matrix [8T /0z] is nonsingular at a point zo € 
D, then it follows from the inverse function theorem! that there is a neighborhood 
N of zo such that T restricted to N is a diffeomorphism on N. A map T is said to 
(R^) = R”? Now 

we have all the elements we need to define feedback linearizable systems. 


Definition 13.1 A nonlinear system — 

- ż = f(z) + G(z)u (13.5) 
where f : D —^ R” and G: D > R?*? are sufficiently smooth? on a domain 
D C R”, is said to be feedback linearizable (or input-state linearizable) if there 


exists a diffeomorphism T : D ^ R” such that D, = T(D) contains the origin and 
the change of variables z = T(x) transforms the system (13.5) into the form 


ż = Az + By(z)[u — o(z)] l (13.6) 


with (A, B) controllable and (x) nonsingular for all x € D. 


When certain output variables are of interest, as in tracking control problems, 
the state model is described by state and output equations. Linearizing the state 
equation does not necessarily linearize the output equation. For example, if the 


system 
iy = asint 
t? = -zl Tu 
has an output y = x, then the change of variables and state feedback control 
1 
2 


Zz =T Z2—a0sinz?j, and u= zri + v 
du e ; 1" acos x2 
yield 
A = Z9 
Z2 = UV 
2] = 
sin (2 
Y a 


1See [10, Theorem 7-5]. 
?T is a global diffeomorphism if and only if [8T/8z] is nonsingular for all z € R” and T is 
proper; that is, límqzi oo IT (z)]] = oo- (See [165] or [212] for a proof of this statement.) 


3By "sufficiently smooth," we mean that all the partial derivatives, that will appear later on, 


are defined and continuous. 
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While the state equation is linear, solving a tracking control problem for y is still 
complicated by the nonlinearity of the output equation. Inspection of both the state 
and output equations in the z-coordinates shows that, if we use the state feedback 


. control u = z? + v, we can linearize the input-output map from u to y, which will 


be described by the linear model 
EA = vU 
y = r 


» 


We can now proceed to solve the tracking control problem using linear control 
theory. This discussion shows that sometimes it is more beneficial to linearize 
the input-output map even at the expense of leaving part of the state equation 
nonlinear. In this case, the system is said to be input-output linearizable. One 


catch about input-output linearization is that the linearized input-output map ' 


may not account for all the dynamics of the system. In the foregoing example, the 
full system is described by 


$i = asint 
$9 = v 
y= zx 


Note that the.state variable z} is not connected to the output y. In other words, 
the linearizing feedback control has made zı unobservable from y. When we design 
tracking control, we should make sure that the variable x is well behaved; that is, 
stable or bounded in some sense. À naive control design that uses only the linear 
input-output map may result in an ever-growing signal z; (t). For example, suppose 
we design a linear conttol to stabilize the output y at a constant value r. Then, 
zı(t) = z1(0) - t asinr and, for sinr 4 0, zi(t) will grow unbounded. This internal 
stability issue will be addressed by using the concept of zero dynamics. 


13.2 Input-Output Linearization 


Consider the single-input-single-output system 


is f(z) + g(z)u (13.7) 
y = A(z) (13.8) 


where f, g, and h are sufficiently smooth in a domain D C R". The mappings 
f: D > R” and g: D — R” are called vector fields on D. The derivative jj is given 


j= eU) opi]  Lph(z)  Loh(z) u 


Ljh(a) = Ëf) 
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is called the Lie Derivative of h with respect to f or along f. This is the familiar 
notion of the derivative of h along the trajectories of the systein t = f(r). The new 
notation is convenient when we repeat the calculation of the derivative with respect 
to the same vector field or a new one. For example, the following notation is used: 


(Lh) 


L,Ljh(r) = or 9 
Lih(z) = LjLjh(z) = PEL) a) 
-1 
Lkh(z) = Ly L§  h(z) = A M ra 


Loh(z) = h(x) 


If L,h(z) = 0, then y = L h(x), independent of u. If we continue to calculate the 
second derivative of y, denoted by y(?), we obtain 


y? z (Lh) 
Ox 
Once again, if Lọ Ljh(z) = 0, then y? = L*h(z), independent of u. Repeating this 
process, we see that if h(x) satisfies 


(x) + g(z)u] = Lih(z) + LoL sh(x) u 


L,Lj  h(z)-0, i= 1,2,...,p—1; LL" h(z) £0 


then u does not appear in the equations of V, Ý., y ^7! and appears in the 
equation of y^^ with a nonzero coefficient: 


y?) = L5h(z) + LyL4  h(z) u 


The foregoing equation shows clearly that the System is input-output linearizable, 
since the state feedback control 


mul 
u = — EL |-L^h(z)-4 «y 
L5 h(z). ^ 
reduces tlie input-output inap to 
y” =v 


which is a chain of p integrators. In this case, the integer p is called the relative 
degree of the system, according to the following definition: 


Definition 13.2 The nonlinear system (13.7)-(13.8) is said to have relative degree 
P, 1 <p <n, ina region Dy C D if f 


LL F h(x) =0, i=1,2,...,p— 1; LoL  h(z) £0 (13.9) 
for all y & Dy. 
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Example 13.1 Consider the controlled van der Pol equation 
ii = T2 
-zi-e(l—-22)z +u, &»0 


T2 
with output y = z;. Calculating the derivatives of the output, we obtain 
| y = isr 

ğ = iz = —noce(l—al)mn tu 

Hence, the system has relative degree two in E?. For the output y = zz, 
y= —:ic&(l—22)54u 

and the system has relative degree one in H?. For the output y = x, + 73, 

ý —z2--2z2|-2; + &(1 T z2)z2 + ul 
and the system has relative degree one in Do = {x € R? | z2 #0}. A 
Example 13.2 Consider the system 


$i = x 
fo = tu 
y. 31 


Calculating the derivatives of y, we obtain 

y e. i 1 = Ti = y 
Consequently, y? = y = z; for all n > 1. In this case, the system does not have 
a well-defined relative degree. Because the example is simple, it is not difficult to 


see why this is so: The output y(t) = r;(t) = e'z1(0) is independent of the pt 
u. 


Example 13.3 A field-controlled DC motor with negligible shaft damping can be 
modeled by the state equation (Exercise 1.17) 


ij = —ax,+4u 
$9 = —brz+ k- cx 173 
$34 = 62,22 


where T1, Z2, and z3 are the field current, armature current, and angular velocity, 
respectively, and a, b, c, k, and @ are positive constants. For speed control, we 
choose the output as y = zs. The derivatives of the output are given by 

ý = £3 = or 172 

y xii, + iir; = (-) + Oxou 
where (-) contains terms which are functions of z. The system has relative me 
two in the region Do = {x € R? | z2 # 0}. 
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Example 13.4 Consider a linear system represented by the transfer function 


bms™ + b. -15 7) +--+ + bo 


Hioc Tas -i8775 + + 0 


where m < n and bm #0. A state model for the system can be taken as- 


t = Ard Bu 
Cr 

where 

0 1 0 0 0 

0 0 1 0 0 
A = , B= 

0 

0 0 1 0 

—a9 —a —üm es 708-1 Jayn 1 axi 
Cez= [ bo by suus bn 0 .. 0 lisa 


This linear state model is a special case of (13.7)-(13.8), where f(z) = Az, g = B, 
and h(x) = Cz. To check the relative degree of the system, we calculate the 
derivatives of the output. The first derivative is 


ý = CAx + CBu 


If m = n — 1, then CB = bn-1 # 0 and the system has relative degree one. 
Otherwise, CB = 0 and we continue to calculate the second derivative y?). Noting 
that CA is a row vector obtained by shifting the elements of C one position to the 
right, while CA? is obtained by shifting the elements of C two positions to the right, 
and so on, we see that 


CAB =0, fori=1,2,....n-m—1, and CA"-™ 1B = bm #0 
Thus, u appears first in the equation of y"-™), given by 
| yem = CA 2 + CAI Bu 
and the relative degree of the system is n — m (the difference between the degrees 
of the denominator and numerator polynomials of H(s)).* A 


4The terminology “relative degree" of a nonlinear system is consistent with the use of the term 
relative degree in linear control theory, which is defined as n — m. 


Figure 13.1: Feedback representation of H (s). 


To probe further into the control of input-output linearizable systems and issues 
of internal stability, let us start with the linear system of the foregoing example. 
The transfer function H(s) can be written as 


N(s) 
D(s) 


H(s) = 


where deg D = n and deg N = m < n. The relative degree p = n—m. By Euclidean 
division, we can write D(s) as 


ý D(8) = Q(s)N (s) + R(s) 


where Q(s) and R(s) are the quotient and remainder polynomials, respectively. 
From Euclidean division rules, we know that 


degQ=n-m=p, degR<m 


and the leading coefficient of Q(s) is 1/b,,. With this representation of D(s), we 
can rewrite H(s) as 


N (s) 
HO = GaN) +R) ^ 


IN 


Thus, H(s) can be represented as a negative feedback connection with 1 /Q(s) in 
the forward path and R(s)/N(s) in the feedback path. (See Figure 13.1.) The pth- 
order transfer function 1/Q(s) has no zeros and can be realized by the pth-order 
state vector 


m T 
f=[y d$ s yer) | 
to obtain the state model pop 


(Ac + BeAT)E + Bebme 
y = Cg 


wm. 
I 
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ia (Ac, Be, Cz) is a canonical form representation of a chain of p integrators; 
at is, 


0 ... 0 


0 1 
0 
0 0- 21i 0 
Ac = , Be= | : |, Cce=[1 0 0 0] (13.10) 
: 0 I 0 
O° ccu D 1 


and A € RP. Let (Ao, Bo, Co) be a minimal realization of the t ] i 
is) Ni) tat , Bo, ation of the transfer function 


H 


à Aon + Boy 
w = Con 
The eigenvalues of Ap are the zeros of the polynomial N (8s), which are the zeros of 


the transfer function H (s). From the feedback connection, we see that H(s) can be 
realized by the state model : 


à = Aon+ BoC ` (13.11) 
E = Ae + B(ATE - b Con + bau) (13.12) 
y = Ce ` (13.13) 


Using the special structure of (Ae, Be, Ce), it is straightforward to verify that 
y? = ATE — bn Con + bmu 
The (input-output linearizing) state feedback control 
` 1 
= gae + b Con + v] 
m 


results in the system 


) = Aon+ BoC € 
€ = A€+ Ew 
y = C€ 


whose input-output map is a chain of p integrators, and whose state subvector 77 
is unobservable from the output y. Suppose we want to stabilize the output at 
a constant reference r, This requires stabilizing £ at £* = (r,0,...,0)7. Shifting 
the equilibrium point to the origin by the change of variables ¢ = € — €* reduces 
the problem to a stabilization problem for ¢ = A.Ç + Bav. Taking v = —K¢ = 
—K(£& — €'), where A, ~ BeK is Hurwitz, completes the design of the control law as 


1 
u- E: + bn Con = K(é = E) 


qn 
ra 
an 
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The corresponding closed-loop system is given by 


Aon + BoC.(€* + C) 
(A. - B.K)C 


7 

¢ 
Because A; — BeK is Hurwitz, for any initial state C(0), we have C(t) — 0 as 
t — oc. Consequently, y(t) — r as t — oo. What about n? Equation (13.11) is 
driven by y = C£ as input. To ensure that n(t) will be bounded for all possible 
waveforms of y(t) and all possible initial states 7(0), we must require Ag to be 
Hurwitz. Equivalently, the zeros of H(s) must lie in the open left-half plane. A 
transfer function having all zeros in the open-left half plane is called minimum 
phase. From a pole placement viewpoint, the state feedback control, we have just 
designed via input-output linearization, assigns the closed-loop eigenvalues into two 
groups: p eigenvalues are assigned in the open-left half plane as the eigenvalues of 
A. — B.K, and n — p eigenvalues are assigned at the open-loop zeros.? 

Our analysis of the linear system of Exemple 13.4 sheds some light on the mean- 
ing of the state feedback control that reduces the input-output map to a chain of 
integrators and how to characterize internal stability. The key tool that allowed us 
to develop this understanding is the stete model (13.11)- (13.13). Our next task is 
to develop a nonlinear version of (13.11)-(13.13) for the nonlinear system (13.7)- 
(13.8) when it has relative degree p. The £ variables are taken the same as in the 


u 


linear case, since the input-output inap will still be a chain of p integrators. We . 


would like to choose the 7 variables to produce a nonlinear version of (13.11). The 
key feature of (13.11) is the absence of the control input u. A change of variables 
that would transform (13.7)-(13.8) into a nonlinear version of (13.11)-(13.13) can 
be taken as : 


di(z) 
dno) é(z) 
z2T(G)-| --- |*# Rp d MUN (13.14) 
h(z) p(z) € 
LP h(a) 


where ġı to n-p are chosen such that T(x) is a diffeomorphism on a domain 
Do C D and ; J . 
—g(z)=0, forl<i<n-p, Vzre€Do (13.15) 


The next theorem shows that ¢, to n-p exist, at least locally. 


—_—_ 

5It should be noted that stabilizing the output at a constant reference does not require the 
system to be minimum phase. This requirement is a consequence of our choice to assign some of 
the closed-loop eigenvalues at the open-loop zeros. 
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Theorem 13.1 Consider the system (13.7)-(13.8), and suppose it has relative de- 
greep € n in D. Ifp=n, then for every zo € D, a neighborhood N of xo exists 


such that the map 
h(x) 
Lyh(z) 
Ly !h(z) 


restricted to N, is a diffeomorphism on N. If p < n, then, for every zo € D, 
a neighborhood N of zo and smooth functions $1(z),....¢n—p(x) exist such that 
(13.15) is satisfied for all z € N and the map T(x) of (13.14), restricted to N, is a 
diffeomorphism on N. o 


Proof: See Appendix C.21. 


The condition (13.15) ensures that when we calculate 
h= DE U(z) + gleh 


the u term cancels out. It is now easy to verify that the change of variables (13.14) 
transforms (13.7)-(13.8) into 


4d. folné) (13.16) 
é = A£ + Boy(z)[u- e(z)] (13.17) 
y = C (13.18) 


where £ € R°, n € R?7?, (Ac, Bc, Cc) is a canonical form representation of a chain 
of p integrators, 


| E 13.19) 
Jolm £) E (z) als ( 


L4h(z) . 


ogee es (13.20) 
L L7 !h(z) 


ylz) = LyL4*h(2) and a(z) = 


We have kept o and y in (13.17), éxpressed in the original coordinates. These 
functions are uniquely determined by (13.20) in terms of f, g, and h. They are 
independent of the choice of ¢. They can be expressed in the new coordinates by 
setting j i 

aoln, £) =a (T7 (z)) and qo(m£) = Y (T7*()) 


which, of course, will depend on the choice of ¢. In this case, (13.17) can be 
rewritten as f 
€ = Ac€ + Beyo(n E[u xd ao(, £)] 
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If z* is an open-loop equilibrium point of (13.7), then (n", £*), defined by 
n =9(2"), &-[h(z) 0 ++ 0] 


is an equilibrium point of (13.16)-(13.17). If y vanishes at z = z*, that is, h(z*) = 0, 
we can transform z* into the origin point (7 = 0, € = 0) by choosing ó(x) such 


that d(x") — 0. 


Equations (13.16) through (13.18) are said to be in the normal form. This form 
decomposes the system into an external part € and an internal part 7. The external 
part is linearized by the state feedback control 


u= a(z) + B(z)v 


where (x) = y~} (x), while the internal part is made unobservable by the same 
control. The internal dynamics are described by (13.16). Setting € = 0 in that 
equation results in 

7 = fo(n,0) (13.21) 
which is called the zero dynamics, a name that matches nicely with the fact that 
for linear systems, (13.21) is given by 7 = Aon, where the eigenvalues of Ap are 
the zeros of the transfer function H(s). The system is said to be minimum phase 


‘if (13.21) has an asymptotically stable equilibrium point in the domain of interest. 


In particular, if T(x) is chosen such that the origin (n = 0, € = 0) is an equilibrium 
point of (13.16)-(13.18), then the system is said to be minimum phase if the origin, 
of the zero dynamics (13.21) is asymptotically stable. It is useful to know that the 
zero dynamics can be characterized in the original coordinates. Noting that 


a y(t) = 0 = £(t) = 0 = u(t) = a(z(t)) 


we see that if the output is identically zero, the solution of the state equation must 
be confined to the set 5 


Z* = {z € Do | A(z) = Lyh(z) = ++» = Le h(a) = 0) 


and the input must be 
def 
u=u"(z) = o(2)|,ez- 


The restricted motion of the system is described by 
! #7.) def 
$ = f'(z) = [f(z) + s(z)a(z)l,ez- 
In the special case p = n, the normal form (13.16)- (13.18) reduces 
à = A4 Bey) - o(z)] (13.22) 
y = Cez (13.23) 


where z = € = [h(z), --- LE h(z)|T and the 7 variable does not exist. In this case, 
the system has no zero dynamics and, by default, is said to be minimum phase. 
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Example 13.5 Consider the controlled van der Pol equation 


$i = 22 
i2; = -r e(l—-z1)5 +u 
y = r 


We have seen in Example 13.1 that the system has relative degree one in R?. Takin 

€ = y and n = zi, we see that the system is already iu the normal form. The 
zero dynamics are given by $4 = 0, which does not have an asymptotically stable 
equilibrium point. Hence, the system is not minimum phase. ` A 


Example 13.6 The system 


; 2 
i = -m +2 By 
$9 = 23 
$3 = 2y23+u 
y = Z2 


has an open-loop equilibrium point at the origin. The derivatives of the output are 


y= $2 = 23 
y= $3 = Titz cu 


Therefore, the system has relative de in R? i 
t gree two in R*, Using L,L;h(z) = 
Lih(z) = 2173 in (13.20), we obtain sa aa: 


y=1 and a(z) = —z,23 
To characterize the zero dynamics, restrict x to 
Z*={re RK? | z2 = 23 = 0) 
and take u = u*(z) = 0. This process yields 
tı = -t1 


which shows that the system is minimum phase. To transform it into the normal 
form, we want to choose a function ó(x) such that 


à 
(0) — 0, aeo) =0 


and 
T()-2[é( m n] 
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is a diffeomorphism on some domain containing the origin. The partial differential 
equation 


can be solved by separating variables to obtain 
@(z) = —a, +23 + tan”! z3 


which satisfies the condition ¢(0) = 0. The mapping T(z) is a global diffeomor- 
phism, as can be seen by the fact that for any z € R3, the equation T(z) = z has a 
unique solution. Thus, the normal form 


. 2 2 
(—n + £ + tan™! &) (: + ide) 


i = 
& = & i 
& = (7 + £z + tan"! €) £g +u 

y= & 


is defined globally. A 


Example 13.7 The field-controlled DC motor of Example 13.3 has relative degree 
two in Do = {z € R? | z2 # 0}. Using (13.20), we obtain 


seer maewe= 0x5(—az1) + Sues +k — cz23) 
T2 
To characterize the zero dynamics, restrict z to 
Z* = {x € Do | z3 = 0 and ziz2 = 0} = {x € Do | z3 = 0 and z; = 0} 
and take u = u*(x) = 0, to obtain 
$9 = —br2 +k 


The zero dynamics have an asymptotically stable equilibrium point at z2 = k/b. 
Hence, the system is minimum phase. To transform it into the normal form, we want 
to find a function ¢(x) such that [8¢/da]g = 09/0z, = 0 and T = [4(z), z3,02122]7 
is a diffeomorphism on some domain D, C Do. The choice ¢(2) = x» — k/b satisfies 
0$/0z, = 0, makes T(x) a diffeomorphism on Ds = {x € R? | z2 > 0), and 
transforms the equilibrium point of the zero dynamics to the origin. A 


Example 13.8 Consider a single-input-single-output nonlinear system represented 
-by the nth-order differential equation 


y™ = p (s z9, Kray zD) y, y, ves qe) 
+q (z, ZY) 20D y y®,... T uu) Z9, m «n (13.24) 


Weeeeeeenrnrteterrercrrerrrnernenenre 
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R where z is the input, y is the output, p(-) and q(-) are sufficiently smooth functions numerator polynomial of the transfer function. The minimum phase property of 
E in a domain of interest, and q(-) # 0. This nonlinear input-output model reduces the system can be determined by studying (13.25). To transform the system into 
5 to the transfer function model of Example 13.4 for linear systems. We extend the the normal form, we note that £ is already a vector of y and its derivatives up to 
g dynamics of the system by adding a series of m integrators at the input side and y (^-U. So, we only need to find a function 9 = $(C,E) : R^" — R™ such that : 
D define u = z(™) as the control input of the extended system. The extended system o d 
5 is of order (n--m). A state model of the extended system can be obtained by taking — 86 B, +4 ô$ B = 
R) ; : OC" * 8r eg(z) = 
K the state variables as " E ; 
S y which is equivalent to 
E z JO 
(1) 0$; | 94: 
z ; ; 
Pu .. ee casa :-|£] ac, + Be, 0 7 9 forl<i<m (13.26) 
z(m-1) Tm In some special cases, there are obvious solutions for these partial differential equa- l 
y tions. For example, if q is constant, ¢ can be taken as 
The state model is given by 1 
l l d i= G- génmi forl <i<m 

-= uÇ + Bye 

é ‘= Ace + Belp(x)  a(z)u] Another case is pursued in Exercise 13.5. A 

y = CE 


where (Ac, Be, C.) is a canonical form representation of a chain of n integrators and 
(Ay, Bu) is a controllable canonical pair that represents a chain of m integrators. 
Let D c R**? be a domain over which p and q are sufficiently smooth and q z 0. 
Using the special structure of (Ae, B.,C;), it can be easily seen that 


y = CAE, for 1€ i € n—-1, and y? = p(z) + q(z)u 


Hence, the system has relative degree n. To find the zero dynamics, notice that 
Ly h(z) = &. Consequently, Z* = (z € R^*" | € = 0) and u*(z) = —p(z)/a(z) 
evaluated at € = 0. Thus, the zero dynamics are given by 


Å = Au + Byu*(z) 


Recalling the definition of €, it can be easily seen that (1 = z satisfies the mth-order 
differential equation i 


0 = p(z,2,...,2("-0,0,0,...,0) +9 {2,2,...,20-0,0,0,...,0) zm) 
(13.25) 
which is the same equation obtained from (13.24) upon setting y(t) = 0. For linear 
systems, (13.25) reduces to a linear differential equation that corresponds to the 


§In this example, we show that the extended system is input-output linearizable, which allows 
us to design feedback contro] using input-output linearization techniques. When such control is 
applied to the origina] system, the m integrators become part of the dynamics of the controller. 


13.3 Full-State Linearization 

The single-input system : : 

t = f(x) + o(z)u (13.27) 

where f and g are sufficiently smooth in a domain D c R”, is feedback linearizable 
if a sufficiently smooth function h : D — R exists such that the system 

f(z) + g(z)u (13.28) 

= h(x) (13.29) 


has relative degree n in a region Do C D. This statement follows from the fact that 
for systems with relative degree n, the normal form reduces to 


Acz + Benr(z)[u — a(z)) (13.30) 
y = Cu (13.31) 


On the other hand, if the system (13.27) is feedback linearizable per Definition 13.1, 
then there is a change of variables ( = S(z) that transforms the system into 


È = AC + B*(z)[u — à(z)] 


where (A, B) is controllable and 4(z) # 0 in some domain. For any controllable 
pair (A,B), we can find a nonsingular matrix M that transforms (A, B) into a 
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controllable canonical form;" that is, MAM-! = A T 
mi , =A,+B,A* and MB = 
(Ac, B.) represents a chain of n integrators. The change of variables NS 
z= MC = MS(z) S T(z) 
transforms the system (13.27) into 
ż = Aez + B.7(x)[u — o(z)] 
_ where (£) = 7(x) and a(x) = G(r) ~ AT MS(z)/4(x). Because 
pu ôT, 
ör 
the equality 
. ôT 
A-T'(z) + Bey(x)[u — a(z)] = a, V + g(z)u] 


must hold for all z and v in the domain of in i 
terest. By tak - i 
foregoing equation into two: l 2 M c 


oT 
a0 = AcT (x) - Beza) (13.32) 
oT 
a: 9 = Box) (13.33) 
Equation (13.32) is equivalent to 
oT, 
AG) = Tals) 
: OT: 
z fle) = T(z) 
ôTn- 
ae fle) = Tala) 
oT, 


and (13.33) is equivalent to 


oT, 
92,49 = 0 
OT, 
p P = 9 
014i 
a; S(t) = 0 
LL E 
i Em T a a(x) #0 
"See, for example, [158]. 
Fw — ee pA E paara g T * : u xem 
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Setting h(z) = Ti (z), we see that 
Tia(z) = LjTi(z) = Lyh(z), $9 152,...,n -1 


h(x) satisfies the partial differential equations 


ftom. 
Loy 


LgLi*h(z) = 0, i2 1,2,.o5n— 1 (13.34) 
subject to the condition — 
LaL h(a) #0 (13.35) 
and a, y are given by 
Lh(z) 
= LL" h(2), a(t) =- TLLA 13.36 
la) = LL, *h(z), ale) A Dy hz) (13.36) 


In summary, the system (13.27) is feedback linearizable if and only if a function 
h(x) exists such that the system (13.28)-(13.29) has relative degree n, or, equiva- 
lently, h satisfies the partial differential equations (13.34) subject to the condition 
(13.35). The existence of h can be characterized by necessary and sufficient condi- 
tions on the vector fields f and g. These conditions use the notions of Lie brackets 
and invariant distributions, which we introduce next. 

For two vector fields f and gon DC R^, the Lie bracket [f,9] is a third. vector 
field defined by 


BRO CORA OR 


_ 99 of 
| Lf alle) Se f) - 5:90 
where [09/02] and [0f /Az] are Jacobian matrices. We may repeat bracketing of g 
with f. The following notation is used to simplify this process: 
adjg(z) = g(t) 


adsg{x) [f g](2) 
adg() = [adj gr) kz1 


1l 


It is obvious that [f, g9] = —I9, f] and for constant vector fields f and g, [fg] = 0. 


=| aou] ZIP 
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1 0 — sin zi; — Z2 —coszi —1 zy 
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ad;g [f,ad sg] 


-1 0 T2 _ 0 1 2) 
1 1 —Sinz; — T2 —coszj -1 zı 29 


= —Z| — 272 
~ | gy +29 —sinz) — Tı COSTI 


il 


A 
Example 13.10 If f(z) = Ax and g is a constant vector field, then 
adyg(x) = [f, 9\(z) = -Ag 
ad4g = [f,adyg] = ~A(—Ag) = 
and 
adẸg = (-1)*A*g 
A 
For vector fields fi, f2, ..., fe on D C R^, let 


A(z) = span{ fi (z), falz), -+ fe(x)} 


be the subspace of R” spanned by the vectors f(x), fo(z), ..., fx(2) at any fixed 
z € D. The collection of all vector spaces A(z) for z € D is L called a distribution 
and referred to by 


A = span( fi, fas. . ak) 
\ 
The dimension of A(z), defined by \ 


dim(A(z)) = rank la), falz), fe(z)] 


may vary with z, but if A = span{ fie S fx}, where (fa(z), ..., f%(x)} are linearly 
independent for all z € D, then dim(A(z)) = k for all z € D. In this case, we say 
that A is a nonsingular distribution on D, generated by fi, ..., fx. A distribution 
A is involutive if 

g1 € A and gE A > [7,9] € A 


If A is a nonsingular distribution on D, generated by fi, ..., fk, then it can be 
verified (Exercise 13.9) that A is involutive if and only if 


[f fle ^, V1SüjEk 
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Example 13.11 Let D = R? and A = span(/i, fo}, where 


212 1 
A=} 1 |, =| 0 
0 T2 


It can be verified that dim(A(z)) = 2 for all z € D and 


0 
[fi fil e En -n= 1 | 
1 


[1 fo] € A if and only if rank [fi (z), fala), [fis falle) = 2, for all z € D. However, 


222 1 0 
rank [fi (z), fa(z) [fi f2](z)) 2 rank] 1 0 0]|253, YzeD 
0 z2 1 
Hence, A is not involutive. : ^ 


Example 13.12 Let D = {x € R° | zf +23 # 0) and A = span( fi, f2}, where 


"s 223 -ti 
f=] -1 |, fz2| —2r2 
0 T3 


It can be verified that dim(A(z)) = 2 for all z € D, 


—4Az 
[fis fe] = sh DEL | | 
0 


and 


273  —z1  —4zg 
rank [fi(z), f2(z), [f1, fz](z)] = rank | -1 -2m 2 | =2, VzcD 
j 0 Z3 0 


Therefore, [f1, f2] € A. Since [fa, fi] = —[fi, fa], we conclude that A is involutive. 
: A 


We are now ready to characterize the class of feedback linearizable systems. 


Theorem 13.2 The system (13.27) is feedback linearizable if and only if there is a 
domain Do C D such that 


1. thé matriz G(x) = [g(z), ad, g(z), . .., ad?  g(z) has rank n for all z € Do; 
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2. the distribution D = span (g, adrg,... ,ad5 ^g) is involutive in Do. o 
Proof: See Appendix C.22. 


In the next three examples, we illustrate the application of Theorem 13.2 and 
the solution of the partial differential equations (13.34). In all examples, we assume 
that the system (13.27) has an equilibrium point z* when u = (0. We choose h(x) 
such that h(z*) = 0. Consequently, the change of variables z = T(x) maps the 
equilibrium point z = z* into the origin z = 0. 


Example 13.13 Reconsider the system 
iz | asin zz | " | 0 EET 
-zj 1 
from Section 13.1. We have 
... 9f. [| -acosz; 
a Ido - So | 0 
The matrix : ; 
0 -acoszr 
G = [g, ad; 9] = | i a o? | 


has rank two for all z such that cosz; # 0. The distribution D = span{g} is 
involutive. Hence, the conditions of Theorem 13.2 are satisfied in the domain Do = 
{z € R? | cosx 40}. To find the change of variables that transforms the system 
into the form (13.6), we want to find h(x) that satisfies 


Oh AL sh) _ 
zI =O; E g9 #0, and h(0)20 
From the condition [9h/8z]g = 0, we have 
oh _ oh _ 
an! ~ Oz2 E 


Thus, h must be independent of z2. Therefore, 
Oh, 
L;h(z) = o5? sin z2 


The condition 

8h), OA) hors 40 

br ? = Ea = On, 00972 
is satisfied in the domain Dp by any choice of h for which (8h/8xi) #0. Taking 
h(z) = z results in the transformation we used earlier. Other choices of A can 
be made. For example, A(z) = Tı + 2? gives another change of variables that 
transforms the system into the form (13.6). A 


= 
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Example 13.14 A single link manipulator with flexible joints and negligible damp- 
ing can be represented by a fourth-order model of the form (Exercise 1.5) 


z= f(x) + gu 
where z 0 
—asinz; — b(zi — z3) [90 
f(z) = T ELEM IE: 
c(zi c T3) d 


and a, b, c, and d are positive constants. The unforced system has equilibrium at 
z — 0. We have i 


0 
of 0 
adyg = |f] =- 5- = —d 
0 
0 
8f bd 
adj9 = [f,adyg]=- 5-adgg — | 4 
—cd 
—bd 
of 0 
ad+g = [f,ad5g] = — 3,049 SEDI, eel 
0 
The matrix 
0 0 0 -bd 
; 0 0 bd 0 
G = |g.adjg, adig adj] — ^9 d o cd 
d 0 -cd 0 


has full rank for all z € R^. The distribution A = span(g, ad fg,ad}) is involutive, 
since g, adyg, and ad?g are constant vector fields. Thus, the conditions of Theo- 
rem 13.2 are satisfied for all z € R^. To find the change of variables that transforms 
the state equation into the form (13.6), we want to find A(z) that satisfies 


i-l ; 3h 
it LO UN i = 1,2,3, NET Nahe and h(0) — 0 
Or ? Ox 


From the condition [Dh/0z]g = 0, we have (8h/Oz4) = 0, so we must choose h 
independent of z4. Therefore, 


nat Solas oh 
Ljh(z) = Zan + 5; e x1 —b(zi — 23)] + r^ 


` 
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From the condition [O(Lh)/8z]g = 0, we have 


(Lh) _ Oh 0 
0x4 A r3 


So, we choose h independent of z3. Therefore, Lh simplifies to 


Lyh(x) = “i 557 t Ss [casn — b(zi — 23)] 
and 
Ljh(z )= aoe z2 + 2C) asins — b(zı — z3)] + n 
ia O(L4h) , O(Lyh) dh 
Bn =0 5 p =0 > PR =0 


and we choose h independent of x2. Hence, 
O(Lih O(LÀh a(L5 h) 
Ljh(z)- n : z2 + di Me ddusrc eise Drs T4 


and the condition M h)/0x]g # 0 is satisfied whenever (Oh/ 871) ) #0. Ther efore, 
we take h(z) = 21. The change of variables 


Ay = h(x) = 2) 

22 = Lyh(r) = 22 l 

Z3 = Lih(z) = —asinz, —b(zi — z3) 
z4 = Ljh(z) = —ozocosz — b(z2 — 24) 


transforms the state equation into 


iy = Z9 
Z9 = Z3 
Z3 = Z4 
i, = -(acosz +b + c)z3 + a(z2 — c) sin zı + bdu 


which is of the form (13.6). Unlike the previous example, in the current one the 
state equation in the z-coordinates is valid globally because z = T(z) is a global 
diffeomorphism. A 


Example 13.15 In Examples 13.3 and 13.7 we considered a field-controlled DC 
motor represented by the third-order model 


z= f(x)+gu 
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where 


ary, 1 
f(z) = | —bz2 +k- criza |, g=]| 0 
2422 0 


and a, b, c, 0, and k are positive constants. We saw that, with the output y = z3, 
the system has relative degree two and hence is partially feedback linearizable. Let 
us investigate whether the state equation is fully linearizable. We have 


r 


a a? 
ad;g  [f.g] = | cars | ; adig =(f,adsg] = | (a + b)czs | 
—0x2 (b = a)8z2 — 0k 


The determinant of 


j 1 a a? 
G —[g,ad;g,ad;g] - | 0 cas (a+ b)ezs 
0 —6z; (b-a)0z, — 6k 
is given by 
det G = cÓ(—k + 2bz2)zs 
Hence, G has rank three for z; # k/2b and z3 # 0. The distribution D = 
span{g, adsg} is involutive if [g, ad;g] € D. We have 


00 0771 0 
[9, ad 9] = Hada) 9 -f 0 1 paH 
dz o- o| | 0 0 


Hence, D is involutive and the conditions of Theorem 13.2 are satisfied in the domain 


Dy- (se m> È and x3 > 0) 


b 
We proceed now to find a function h that satisfies (13.34) and (13.35). The unforced 
system has an equilibrium set at zı = 0 and z2 = k/b. We take the desired operating 
point as z* = [0, k/b, wo]T, where wo is a desired set point for the angular velocity 
Z3. We want to find h(z) that satisfies 


dh A(Lsh) ay) 
p ar ITO 9#0 
with h(z*) = 0, From the condition 
Oh ah o 
an! zm Or; = 


we see that h must be independent of z. Therefore, 


Oh Oh 
Lysh(x) = $5, | 00a +k ~ cx 123] + 85, m 


. 530 CHAPTER 13. FEEDBACK LINEARIZATION 


From the condition [O(L5^)/0z]|g = 0, we have 


oh Oh 
CI3 dna = fran. 


which is satisfied if h takes the fórm l 
h= c [022 + cx?) T c2 


for some constants cı and co. We choose ci 
h(z*) = 0, we take 


= ] and, to satisfy the condition 


—6(k/b)? — cuj 
With this choice of h, Lyh and L?h are given by 


c2 = -6 (23)? — c (25)? = 


Lyh(x) = 2022(k — baa), L'h(z) = 20(k — 2bx2)(—bae + k — cx123) 


Hence, ; : 
AED. (Lzh) 
Ar zi m = —2c O(k — - 2b25)23 


and the condition [8(L3h)/8z]g # 0 is satisfied whenever z2 # k/2b and z3 # 0. 
Assuming z3 > 0, it can be easily verified (Exercise 13.15) that the map z = T(z) is 
a diffeomorphism on Do and the state equation in the z-coordinates is well defined 
in the domain 


0k? 
D, =T(Do) = [z € R? | z1 > 0¢?(22) — 6(k/b)* — cw and z3 < = or \ 


where ó(-) is the inverse of the map 20z3(k — ba2), which is well defined for z2 > 
k/2b. The domain D, contains the origin z = 0. A 


13.4 State Feedback Control 
18.4.1 Stabilization 


Consider a partially feedback linearizable system of the form 


fo(n, £) (13.37) 
Ag + By(z)[u — o(z)] (13.38) 


4 
é 


[2] -n0=[ 28] 


T(x) is a diffeomorphism on a domain D C R^, D, = T(D) contains the origin, 
(A, B) is controllable, y(x) is nonsingular for all z € D. fo(0.0) = 0. and fo(7.), 


where 


Vélo. ii aiio ey an M ate Mo tappe lips SD ae Nae A ORE RRS NC NN ee: Sle elle Mathes 
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a(x), and y(x) are continuously differentiable. Our goal is to design a state feed- 
back control law to stabilize the origin z = 0. The form (13.37)-(13.38) is clearly 
motivated by the normal form (13.16)-(13.18) of input-output linearizable systems. 
However, (13.18) is dropped since the output y plays no role in the state feedback 
stabilization problem. The system (13.37)-(13.38) includes also feedback lineariz- 
able systems by dropping equation (13.37). We do not restrict our discussions to 
single-input systems or to a pair (A, B) in the controllable canonical form. We 
proceed to discuss the more general system (13.37)-(13.38) and our conclusions will 
apply to the normal form (13.16)-(13.18) or to feedback linearizable systems as 
special cases. 
The state feedback control 


u=a(z) + 8(x)v 
where G(x) = 47! (z), reduces (13.37)-(13.38) to the “triangular” system 
7 = fo(n€) (13.39) 
é = ACE BV (13.40) 
Equation (13.40) can be easily stabilized by v = —Ké, where K is designed such 
that (A— BK) is Hurwitz. Asymptotic stability of the origin of the full closed-loop 
system . 
à = fm (1341) 
é = (A- BK) (13.42) 


follows from asymptotic stability of the origin of 7 = fo(n, 0), as shown in the next 
lemma. 


Lemma 13.1 The origin of (13.41)-(13.42) is asymptotically stable if the origin of 
7j = fo(n,0) is asymptotically stable. o 


Proof: By (the converse Lyapunov) Theorem 4.16, there is a continuously differen- 
tiable Lyapunov function V; (5) such that 


Vi 
Fy fon 0) € —ox(]lrl) 


in some neighborhood of 7 = 0, where o3 is a class K function. Let P = PT > 0 
be the od * P Lyapunov equation P(A — BK) + (A — BK)T P = —I and 


use V(n,€) = Vi (n) + ky TPE, with k > 0, as a Lyapunov function candidate for 
(13.41)-(13.42). i The derivative V is given by - 
: avy T T 
V = P(A — BK) + (4 - BKY P 
By 1008) + ses PA- BK) + (A BOF PK 


8The function V(n,€) is continuously differentiable everywhere around the origin, except on 
the manifold £ = 0. Both V (7, €) and V(n, £) are defined and continuous around the origin. It can 
be easily seen that the statement of Theorem 4.1 is still valid. 
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OV; ov, 2 kéTE 
“Gy 1060) + gy PoE) = fol) 2/ET FÉ 


On any bounded neighborhood of the origin, we can use continuous differentiability 
of V1 and fo to obtain 


V < -os (inl) + kie] — all 


for some positive constants ky and ks. Choosing k > k;/k2 ensures that V is nega- 
tive definite. Hence, the origin is asymptotically stable. D 


The foregoing discussion shows that a minimum phase input-output linearizable 
system can be stabilized by the state feedback control 


u = o(z) — B(x) KT2(z) 


The control (13.43) is independent of Tj(z). Therefore, it is independent of the 
function ¢ that satisfies the partial differential equation (13.15). : 

'The proof of Lemma 13.1 is valid only on bounded sets. Hence, it cannot 
be extended to show global asymptotic stability. We can show global asymptotic 
stability by requiring the system 7) = fo(n, £) to be input-to-state stable when £ is 
viewed as the input. 


Lemma 13.2 The origin of (13.41)-(13.42) is globally asymptotically stable if the 
system 7) = fo(n, £) is input-to-state stable © 


(13.43) 


Proof: Apply Lemma 4.7. D 


Input-to-state stability of 7 = fo(n, €) does not follow from global asymptotic, 
or even exponential, stability of the origin of 7 = fo(1,0), as we saw in Section 4.10. 
Consequently, knowing that an input-output linearizable system is "globally" min- 
imum phase does not automatically guarantee that the control (13.43) will globally 
stabilize the system. It will be globally stabilizing if the origin of 7 = fo(n, 0) is 
globally exponentially stable and fo(n, €) is globally Lipschitz in (7, £), since in that 
case Lemma 4.6 confirms that the system 7) = fo(7, €) will be input-to-state stable. 
Otherwise, we have to establish input-to-state stability by further analysis. Global 
Lipschitz conditions are sometimes referred to as linear growth conditions. The 
next two examples illustrate some of the difficulties that may arise in the absence 
of linear growth conditions. 


Example 13.16 Consider the second-order system 
ho = —n+0€ 
€= v 


While the origin of ù = —7 is globally exponentially stable, the system 7 = =n +n?E 
is not input-to-state stable. This fact can be seen by noting that (t) = 1 and 
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7(0) > 2 imply that 7(t) > 2. Therefore, n grows unbounded. On the other hand, 
by Lemma 13.1, we see that the linear control v = —k£, with k > 0, stabilizes the 
origin of the full system. In fact, the origin will be exponentially stable. However, 
this linear control does not make the origin globally asymptotically stable. Taking 
v = nê and noting that 

D= nE + nt = kne = nE t r£ = -(1+ bv V? ; 
we see that the set (n£ < 1+k} is positively invariant. On the boundary nf = 1+k, 
the trajectory is given by n(t) = e**n(0) and £(t) = e~**€(0). Thus, n(t)€(t) = 1+k. 
Inside the set {nE < 1+k}, v(t) will be strictly decreasing and after a finite time T, 
v(t) < 1/2 for all t > T. Then, nh € ~(1/2)n?, for all t > T, which shows that the 
trajectory approaches the origin as t tends to infinity. Hence, the set {nf <1+ k} 
is the exact region of attraction. While this conclusion shows that the origin is not 
globally asymptotically stable, it also shows that the region of attraction expands 
as k increases. In fact by choosing k large enough, we can include any compact set 
in the region of attraction. Thus, the linear feedback control v = —k€ can achieve 
semiglobal stabilization. A 


If the origin of 7) = fo(n,0) is globally asymptotically stable, one might think 
that the triangular system (13.39)-(13.40) can be globally stabilized, or at least 
semiglobally stabilized, by designing the linear feedback control v = -K € to assign 
the eigenvalues of (A — BK) far to the left in the complex plane so that the solution 
of £ = (A — BK)€ decays to zero arbitrarily fast. Then, the solution of és fo(n,£) 
will quickly approach the solution of ù = fo(n,0), which is well behaved, because 
its origin is globally asymptotically stable. It may even appear that this strategy 
is the one used to achieve semiglobal stabilization in the preceding example. The 
next example shows why such strategy may fail.? 


Example 13.17 Consider the third-order system 


q > - 4(1 + &)n? 
& = & 
€& = v. 


The linear feedback control 
v = ~k? — 2k£s & -KE 
assigns the eigenvalues of 


z fo 1 
A BK=| o x | 


a SS = . 
See, however, Exercise 13.20 for a special case where this strategy will work. 
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at —k and —k. The exponential matrix 


(1+ kt)e-*t te*t | 
g(4- BK)t _ 


—k*te*t (1 — kt)e-*t 


shows that as k 4 oo, the solution £(t) 


will decay to zero arbitrarily fast. Notice, 
however, that the coefficient of the (2, 


1) element of the exponential matrix is a 
reaches a maximum value k/e at t = 1/k. i 
zero arbitrarily fast by choosing large, 
order of k. The phenomenon is known as 
of peaking with nonlinear growth could destabilize the system. In particular, for 
the initial states 7(0) = no, &(0) = 1, and (0) = 0, we have &2(t) = —k?te—*t and 


=- i (1 - K?te- M) n? 


During the peaking period, the coeffici 
Eventually, the coefficient of 7° will b 
Soon enough, since the system might hi 


ent of 7? is positive; causing |7(t)| to grow. 
ecome negative, but that might not happen 
ave a finite escape time. Indeed, the solution 
2 


2 "0 

t) = —— rr — M 
7 (0) 1+nglt+ (1-- kite" — 1] 
shows that if 7? > 1, thes 


ystem will have a finite escape time if k is chosen large 
enough. 


A 


While feedback linearization provides a simple and systematic procedure for 
stabilizing a class of nonlinear s 


ystems, there are legitimate concerns about the 
robustness and efficiency of such design. In the remainder of this section, we shed 
some light on these two issues. 


Feedback linearization is based on exact mathematical cancellation of the non- 
linear terms o and Y: Which requires exact knowledge of o, 8 = 47}, and Ty. This 
is almost impossible for several practical reasons such as model simplification, pa- 
rameter uncertainty, and computational errors. Most likely, the controller will be 

"implementing functions å, 6, and To, which are approximations of o, 8, and T3; 


that is to say, the actual controller will be implementing the feedback control law 


u = A(z) — B(z) K'fo(a) 


— a a 
10To read more about the peaking phenomenon, 
phenomenon in high-gain observers, see Section 14.5 


see [188]. For an illustration of the peaking 
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The closed-loop system under this feedback control is 
7 = f o(n. £) : : 
é Ag + By(z)là(z) - B(x) KTa(x) - a(z)] 
By adding and subtracting the term BKE to the right-hand side of the second 
equation, we can rewrite the closed-loop system as 
ñ = folm€) - (13.44) 
é (A- BK)£ + Bó(z) (13.45) 


where 


(2) = v(2)(&() — oz) + [6(@) - x) Taa) + ÅKT) - GL 


Thus, the closed-loop system appears as a perturbation of the nominal system 
ù = fo(m&) 
€ = (A-BKX% 


In view of the perturbation results of Chapter 10, we do not expect a serious ana 
from a small error 6(z). The next two lemmas confirm this expectation. e star 
with feedback linearizable systems where the closed-loop equation simplifies to 


à -(A- BK)z + Bó(z) (13.46) 


Lemma 13.3 Consider the closed-loop system (13.46), where (A-— BK) is Hurwitz. 
Let P = PT > 0 be the solution of the Lyapunov equation 


P(A- BK) * (A- BK)'P 5 -I 
and k be a nonnegative constant less than 1/(2]| PB||g). 


e If ||6(z)|| € k||z|| for all z, the origin of (13.46) will be globally exponentially 
stable. 


e If ó(z)]| € k||zl| +e for all z, the state z will be globally ultimately bounded 
by ec for some c >Q. 


Proof: Let V(z) = z7 Pz. Then 

y zl |P(A - BK) + (A - BK)? P]z +227 PB6(z) 
-|izli + 21 Bla] zia llo (z) lo 
If ||ó(2)ll < kl|z]]|a +£, we have 


V -|zli + 2k|PBllalzl *2eliPBlallela. 
-Q - 41) [213 — 81 lzel? + 2k P Bilal zl + 2e P Blei 
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where 0, € (0,1) is chosen close enough to one such that k < 0;/(2]| PB). Conse- 
quently, ; i 

Y < -(1 - 6:)lzlf2 + 2el|PBll2llzll2 
If ||6(z)||2 < kllzll2, we set € = 0 in the preceding inequality and conclude that the 
origin is globally exponentially stable. If € > 0, 


. 2e|PBl|[ aet 
-(1.— mo 2 > ———— = 
vs-01-00- blz, Yle gee t 
where 92 € (0,1). Application of Theorem 4.18 shows that z(t) is globally ulti- 
mately bounded by Eco y Amax(P)/ Amin (P). (m) 


It is clear from the proof that if the bound on ó(z) is satisfied only in a neigh- 
borhood of the origin, we can prove a local version of the lemma. 


Example 13.18 Consider the pendulum equation 
di = ES 
$9 =  —asin(z;-F ài) — bz; + cu 


where zı = 0 — ô1, £2 = 6, andu=Tisa torque input. The goal is to stabilize the 
pendulum at the angle 0 = à. A linearizing-stabilizing feedback control is given 
by 
QN . 1 
u- (2 sin(z; + ài) — G) (kizi + koza) 


where kı and kz are chosen such that 


PERES | koia | 


is Hurwitz. Suppose that, due to uncertainties in the parameters a and c, the actual 
control is 


a\ 1 
u= (3) sin(zi + à) — G) (kızı + kozo) 

where à and ĉ are estimates of a and c. The closed-loop system is given by 
$i = 22 


Lo = —khzi = (ke + bra + ó(x) 


where 


é(z) = (= - 2) sin(zi +61) — (5:3) (kızı + kee) 
The error term ó(z) satisfies the bound |ó(z)| € &llx|lo + € globally, where 


(+H, ec |t 


— aé 


é 


c—é 


adc — aĉ 


z | sin ô1| 


k= 
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The constants k and € are measures of the size of the error in estimating the pa- 


rameters a and c. Let 
P= | Pu pu | 
Pi2 p22 


be the solution of the Lyapunov equation P(A — BK) + (A - BK)? P = —I. If 


k< F 3 


2/pi; + Pao 


then the solutions of the system are globally ultimately bounded by a bound that is 
proportional to €. If sind, = 0, the foregoing bound on k ensures global exponential 
stability of the origin. A 


We turn now to the more general closed-loop system (13.44)- (13.45). 


Lemma 13.4 Consider the closed-loop system (13.44)-(13.45), where A — BK is 
Hurwitz. 


e If ||o(z)|| € € for all z and ù = fo(n,€) is input-to-state stable, then the state 
z is globally ultimately bounded by a class K function of e. 


e If||ó(z)|| < k||z|| in some neighborhood of z = 0, with sufficiently small k, and 
the origin of 7 = fo(n, 0) is exponentially stable, then z = 0 is an exponentially 
stable equilibrium point of the system (13.44)- (13.45). 


o 


Proof: Let V(£) = £T P£, where P = PT > 0 is the solution of the Lyapunov 
equation P(A — BK) + (A — BK)TP = —I. Then 


V = £T[P(A - BK) +(A— BK)! Py + 2€7 PBé(z) 
< -l&i + 2lPBllall£llalié(z)lla 


If ||2(z)]| < e, we have 
V < -JE + 2l PBllsllells < —ANEl2, v ll£lla 2 4el|PBlle 


Hence, applying Theorem 4.18 shows that a finite time to and a positive constant c 
exist such that 
l l&)la < ee Yt 2 to 


By input-to-state stability of ?j = fo(n, €), we have 


IIn(t)|l2 < &o(lIn(to)]la; t — to) + Yo(sup l2). Bo((In(to)ll2,t — to) + Yo(ce) 


where f and yọ are class KL and class K functions, respectively. The term 
Ao(|In(to)|l2,t — to) satisfies Bo < € after some finite time. Therefore, ||z(£)|| is 


ioi e 
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ultimately bounded by ce + ¢ + ich i i 

Yo(ce), which is a class X function of €. To 
the second case of the lemma, recall from Theorem 4.14 that a Lyapunov Pion 
Vi (7) exists in some neighborhood of 7 = 0 such that 


call < V) < call, SÉ fo(n,0) < llf 


avi 
On 


S ealln|la 
2 


Using V(z) = bVi(n) + € PE, with b > 0 i i 
aaa cea € wi ; as a Lyapunov function candidate for 


; av, av: 
v = d P 0) ux £) — fo(n,0)J 


+ €"[P(A - BK) + (A BK)" Plé + 267 PB6(z) 
S besini? + bcaL|nilallella — IEN + 2k|PBlia£ll2 + 2k||PBll|léllalinll2 


= [mls 77 be - (E||PB |]; + baL 
LJ T 
dt — [ (alle 17 f lol 
[ ke] el lel | 


where L is a Lipschitz constant of fo with respect to £. Taking b = k, it can be 


verified that Q is positive definite for sufficie tl ; igin i 
iudei ntly small k. Therefore, the origin B 


In Exercises 13.22 through 13.24, we present a few variations of Lemma 13.4 
If )- fo(7,&) is not input-to-state stable, but the origin of 7 = fo(n, 0) is as in i 
totically stable, we can prove a local version of the first case of the lemma (Exe- 
cise 13.22). If f (n, €) is globally Lipschitz and the origin of 7 = fo(r, 0) is globally ex- 
ponentially stable, we can prove a global version of the Second case (Exercise 13.23) 
al = ihn se i p Ki 0) resides trond but not exponentially, stable, we. can 

c stability of the origi - icti 

Ra ace (i di pn is of the closed-loop system by restricting the 


The feedback control u — a(z) — B(z)K€ has a linearizing component u = 
a(z) + B(z)v and a stabilizing component v = —Kf. The foregoing Lyapunov 
analysis shows that the stabilizing component achieves a certain degree of robustness 
to model uncertainty. 1} We will see in Chapter 14 that the stabilizing component 
can be designed to achieve a much higher degree of robustness by exploiting the 
fact that the perturbation term Bé(z) in (13.45) belongs to the range space of the 
Input matrix B. Such perturbation is said to satisfy the matching condition. The 


techniques of Chapter 14 can guarantee robustness t i 
n uid o any ó(z) provided an upper 


AA ei pee n 
1] n 
Another type of model uncertainty that is not considered here is the sensitivity of the relative 


degree and the minimum phase property to ramet i i 
dui 4 ALE Property to parameter perturbations. To read more about this 
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The basic philosophy of feedback linearization is to cancel the nonlinear terms 
of the system. Aside from the issues of whether or not we can cancel the nonlincar 
terms, effect of uncertaintics, implementation factors, and so on, we should examine 
the philosophy itself: Is it a good idea to cancel nonlinear terms? Our motivation to 
do so has been mathematically driven. We wanted to linearize the system to make it 
more tractable and to use the relatively well-developed linear control theory. From 
a performance viewpoint, however, a nonlinear term could be “good” or “bad” and 
the decision whether we should use feedback to cancel a nonlinear term is, in reality, 
problem dependent. Let us use a couple of examples to illustrate this point. 


Example 13.19 Consider the scalar system 
i-or- bz? +u 


where a and b are positive constants. A linedeizing-stabilizing feedback control can 


be taken as 
u--(k-ta)robz, k»0 


which results in the closed-loop system t = —kz. This feedback control cancels the 
nonlinear term —bz?, but this term provides “nonlinear damping.” In fact, without 
any feedback control, such nonlinear damping would guarantee boundedness of the 
solutions despite the fact that the origin is unstable. So, why should we cancel it? 
If we simply ‘use the linear control 


u=-(k+a)z, k»0 
we will obtain the closed-loop system 
t = —kx — bz? 


whose origin is globally exponentially stable and its trajectories approach the origin 
faster than the trajectories of £ = —kx. Moreover, the linear control is simpler and 
uses less control effort. A 


Example 13.20 Consider the second-order system 
ii = x2 
Ig = —h(zi) +u 


where A(0) = 0 and zih(zi) > 0 for all zı 4 0. The system is clearly feedback 
linearizable and a linearizing-stabilizing feedback control can be taken as 


u= h(zi) — (kizi + ka23) 


where kı and kz are chosen to assign the closed-loop eigenvalues at desired locations 
in the left-half complex plane. On the other hand, our study of passive systems in 
Chapter 7 shows that with the feedback control 


u = —o (x2) 


ze 
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where c is any locally Lipschitz function that satisfies c(0) = 0 and yo(y) > 0 for 
y Æ 0, the closed-loop system will be passive, and the derivative of the Lyapunov 
function V = fj" h(z) dz + (1/2)22 is given by i 


/ = —z30(z2) 


Because 

zo(t) =0 > Z(t) =0 > k(zı(t)) =0 > zi(t) zm 

asymptotic stability of the origin follows from the invariance principle. The control 
u = —c (z2) has two advantages over the linearizing feedback control. First, it does 
not use a model of the nonlinear function h. Hence, it is robust to uncertainty in 
modeling h. Second, the flexibility in choosing the function ø can 'be used to reduce 
the control effort. For example, we can meet any constraint of the form jul < k, 
by choosing u = —k sat(z2). However, the control u = —o(z2) cannot arbitrarily 
assign the rate of decay of z(t). Linearization of the closed-loop system at the origin 
yields the characteristic equation 


s? + o'(0)s + (0) =0 ` 
One of the two roots of the foregoing equation cannot be moved to the left of 
Re[s] = —/h’(0). Feedback control laws that exploit passivity properties will be 
discussed in Section 14.4. A 


These two examples make the point that there are situations where nonlinearities 
are beneficial and cancelling them should not be an automatic choice. We should 
try our best to understand the effect of the nonlinear terms and decide whether or 
not cancellation is appropriate. Admittedly, this is not an easy task. 


The robustness and efficiency concerns we raised regarding feedback linearization 
as a design procedure should not undermine the feedback linearization theory we 
developed in this chapter. The theory provides us with valuable tools to characterize 
a class of nonlinear systems whose structure is open to feedback control design, 
with or without nonlinearity cancellation. The concepts of relative degree and zero 
dynamics of nonlinear systems bring into focus the common input-output structure 
of linear and nonlinear systems and play a crucial role in extending to nonlinear 
systems some of the feedback design procedures that were successfully used for 
linear systems, such as high-gain feedback. The ability to transform a system into 
a normal form, where nonlinear terms enter the state equation at the same point 

` as the control input, brings in the matching condition structure that will be used 
in Chapter 14 to develop some useful robust control techniques. 


13.4.2 Tracking 


Consider a single-input-single-output, input-output linearizable system represented 
in the normal form (13.16)-(13.18): 


7 = fo(n,€) 


oo Sav Perro a 02946 


————————————— 
so ', 
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é = Acé + Bey(x)[u - a(z)] 
= C£ 


Without loss of generality, we assume that fo(0,0) = 0. We want to design a 
state feedback control law such that the output y asymptotically tracks a reference 
signal r(t). When the system has relative degree p = n, it has no nontrivial zero 
dynamics. In this case, the 7 variable and its equation are dropped, but the rest of 
the development remains the same. We assume that 


e r(t) and its derivatives up to r(? (t) are bounded for all t > 0 and the pth 
derivative r°)(z) is a piecewise continuous function of t; 


e the signals r,.. . r^ are available on-line. 


The reference signal r(t) could be specified, together with its derivatives, as some 
given functions of time, or it could be the output of a reference model driven by 
some input signal w(t). In the latter case, the assumptions on r can be met by 
appropriately choosing the reference model. For example, for a relative degree two 
system, a reference model could be a second-order linear time-invariant system 
represented by the transfer function 
n w? 
8? + 26048 + w2 
where the positive constants Ç and wn are chosen to shape the reference signal r(t) 


for a given input signal w(t). The signal r(t) can be generated on-line by using the 
state model i ; 


y= ye 
te = -wiy — wry + wew 
T — 1 


Therefore, r(t), ?(t), and #(t) will be available on-line. If w(t) is a piecewise con- 
tinuous bounded function of t, then r(t), 7(t), and 7(t) will satisfy the required : 
assumptions. j 
Let l 
r &-r 
R= : ; e= 


: : =E-R 
ple) £, — r(^-0 


The change of variables e = £ — R yields 


folne +R) 
Ace + Be {-(2)fu - a(2)] = 709) 


ù 
é 
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The state feedback control 
u = a(z) + p(z) [v T aud 
where B(z) = 1/^(x), reduces the normal form to the cascade system 


" = fome + R) 
é Ace + Bev 


Our control objective can be met b i 

: tive y any design of v that stabilizes the 
equation while maintaining 7 bounded for all t 2 0. With v = —Ke, where A p, p 
is Hurwitz, the complete state feedback control is given by!? us 


u= a(z) + A(z) ( -K[T»(z) - R] + p (13.47) 

and the closed-loop system is given by 
ù = folme +R) (13.48) 
€ = (A.- B.K)e (13.49) 


For minimum phase Systems, the origin of 7) — 0) is i 

It follows from (the converse Lyapunov function) eae 416 d SA p 
kp for sufficiently small e(0), n(0), and R(t), the state z(t) will be bounded for all 
t 2 0. Thus, the state feedback control (13.47) solves the local tracking problem. To 
extend the validity of the control to global tracking, where R(t) can be any bounded 
function of t, we face the same issues we encountered in global stabilization. A 
sufficient condition to ensure global tracking is input-to-state stability of the system 


1 = fo(n, €). 


Example 13.21 Consider the pendulum equation 


$i = r 
$2 = ~asinz, — bro + cu 
y = n 


E system has relative degree two in R? and is already represented in the normal 

ie i pend dn zero dynamics, so it is minimum phase by default. We 

want the output y to track a reference signal r(t), with b ivati F 

e ud gnal r(t), w ounded derivatives 7(t) 
€j—I;—-T, & =T -f 

we obtain 


éi = €9 
€? = asing, — br + cu -F 


—————————ÀM——— 
12As in Section 13.2, 7; i 
-4, 42 comprises the last p components of the diffeo i 
transforms the system into the normal form. SMERA eel 
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Output 


Figure 13.2: Simulation of the tracking control of Example 13.21. 


The state feedback control (13.47) is given by 
T. 2 
u= zlesinzı T bro +7 — kie, — kze2] 


where K = [k;, k2] is designed to assign the eigenvalues of A. — B.K at desired 
locations in the open left-half complex plane. Because all the assumptions hold 
globally, this control achieves global tracking. Figure 13.2 shows the response of 
the system when a = c= 10, b = 1, kj = 400, and kz = 20 to some reference signal. 
The solid curve is both the reference signal and output signal in the nominal case; 
they are identical. Here, tracking is achieved for all t and not just asymptotically, 
because z(0) = (0). If z(0) # (0), tracking will be achieved asymptotically, 
which is shown by the dashed curve. Finally, the dotted curve shows the response 
of the system when b and c are perturbed to b = 0.5 and c = 5, which correspond 
to doubling the mass. A 


In many control problems, the designer has some freedom in choosing the ref- 
erence sigual r. For example, oue of the typical problems in controlling robot 
manipulators is moving the manipulator from an initial to a final point within some 
time interval. The first task in approaching this problem is planning the path be- 
tween the two points, which has to comply with any physical constraints due to the 
presence of obstacles. Then, the motion trajectory is planned by specifying veloci- 
ties and accelerations of the moving parts as functions of time. The outcome of this 
trajectory planning process is the reference signal that the output variable has to 
track.!3 The freedom in choosing the reference signal can be used to improve the 
performance of the system, especially in the presence of constraints on the control 
signal. The next example illustrates this point. 


13To read about trajectory planning in robot manipulators, see [171]. 
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Example 13.22 Reconsider the pendulum equation of the previous example with 
the nominal parameters a = c = 10 and b = 1. Suppose the pendulum is resting at 
the open-loop equilibrium point z = 0 and we want to move it to a new equilibrium 
point at zı = 7/2 and z2 = 0. Taking the reference signal r as the output of the 
second-order transfer function 1/(rs + 1)? driven by a step input w will provide the 
desired motion if the jump in w is taken as 7/2. The tracking control is taken as 


u = 0.1(10sin zı + z2--f — kiei — koe2) 


where k, = 400 and kz = 20. Taking the initial conditions of the reference model 
to be zero, we find that the tracking error e(t) = x(t) — R(t) will be identically 
zero and the motion of the pendulum will track the desired reference signal for all t. 
The choice of the time constant 7 determines the speed of motion from the initial 
to the final position. If there were no constraint on the magnitude of the control 
u, we could have chosen 7 arbitrarily small and achieved arbitrarily fast transition 
from zı = 0 to zı = 7/2. However, the control input u is the torque of a motor 
and there is a maximum torque that the motor can supply. This constraint puts 
a limit on how quick we can move the pendulum. By choosing 7 to be compatible 
with the torque constraint, we can achieve better performance. Figure 13.3 shows 
two different choices of when the control is constrained to |u| € 2. For 7 = 0.05 
sec, the output y(t) deviates from the reference r(t), reflecting the fact that the 
reference signal demands a control effort that cannot be delivered by the motor. 


On the other hand, with 7 — 0.25 sec, the output signal achieves a good tracking of 


the reference signal. In both cases, we could not achieve a settling time better than 
about 1.2 seconds, but by choosing 7 = 0.25, we were able to avoid the overshoot 
that took place when 7 — 0.05. A 


13.5 Exercises 


13.1 Consider the third-order model of a synchronous generator connected to an 
infinite bus from Exercise 1.8. Consider two possible choices of the output: 


(1) 9-5 (2) y=d +45, 4:40 


In each case, study the relative degree of the system and transform it into the 
normal form. Specify the region over which the transformation is valid. If there are 
nontrivial zero dynamics, find whether or not the system is minimum phase. 


13.2 Consider the system 
tı = —Zj-c22—23, Ë= —1,273 — T2 +U, f3=-21+u, gy-zrs 


(a) Is the system input-output linearizable? 
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120.05 | 120,25 


0 0.5 1 1.5 2 0 0.5 1 1.5 2 
120.05 120.25 
2 2 
1 1 
E 5 
€ 0 z 
8 8° 
-1 -1 
-2 -2 
0 0.5 1 15 2 0 0.5 
Hre , dius 1.5 2 


Figure 13.3: Simulation of the tracking control of Example 13.22. 
(b) If yes, transform it into the normal form and specify the region over which the 
transformation is valid. 


(c) Is the system minimum phase? 


13.3 Consider the inverted pendulum of Exercise 1.15 and let 6 be the output. Is 
the system input-output linearizable? Is it minimum phase? 


13.4 Consider the system of Example 12.6. Is the system input-output lineariz- 
able? Is it minimum phase? 


13.5 With reference to Example 13.8, consider the partial differential equations 
(13.26). Suppose q(z) is independent of Cm and £n. Show that ¢; = G forl1<i< 
m — 1 and ¢m = Çm — &n/9(x) satisfy the partial differential equations. i 


13.6 Show that the state equation of Exercise 6.11 is feedback linearizable. 


1 
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13.7 Show that the state equation of the m- 


linearizable. link robot of Exercise 1.4 is feedback 


13.8 Prove the Jacobi identity 
Lis gh(z) = Lj Lsh(z) — LL sh(z) 
where f and g are vector fields and h is a real-valued function. 


13.9 Let A be a nonsingular distribution on D, generated by fy, . 


that A is involutive if and only if [fi, jj e A, V1< ij sr. paleo anew 


13.10 Let 
Tı —e72 
1 
AG- 9 |, fle)=| 0 
T3 0 


D = Rand A= span{ fi, fo}. Show that A is involutive. 
13.11 Consider the system 


$£i—zpbr $z =3r?t +2 +u, 


(a) Is the system input-output linearizable? 


, y = ~r} + zo 


- (b) If yes, transform it into the normal form and speci i i 
' ecify the re, 
transformation is valid, dios Und 
(c) Is the system minimum phase? 
(d) Is the system feedback linearizable? 


(e) If yes, find a feedback control 1 


aw and a change of variables that Ji i 
state equation. l cA 


13.12 Repeat the previous exercise for the System 
Íi = -z1 +212}, t2=29+273, z= ó(z) +u, 
where 5(z) is a locally Lipschitz function of z. 


13.13 An articulated vehicle (a semitrailer- 
state equation 


yz; zr 


like vehicle) can be modeled by the 


$i = tan(x3) 
s E tan(z) 1 
$9 = - bcos(z»)cos(z.Y 
2 acos(z3)  bcos(z;) cos(z3) iri 
i tan(x2) 
acos(z3) 


where a and b are positive constants. Show that system is feedback linearizable. 
Find the domain of validity of the exact linear model. 
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13.14 Consider the system 


ii = —T1 + T2 — T3, İz = -—z123— T2 +U, 23=-7,+u 


(a) Is the system feedback linearizable? 


(b) If yes, find a feedback control law and a change of variables that linearize the 
state equation. 


13.15 Verify that the map z = T(z) in Example 13.15 is a diffeomorphism on Do, 
and the state equation in the z coordinates is well defined on D; = T (Do). 


13.16 Consider the pendulum of Example 12.2 with the numerical data of Exer- 
cise 12.1. Design a stabilizing state feedback control law via feedback linearization, 
locating the closed-loop eigenvalues at the same locations used in Exercise 12.1. 
Compare the performance of the closed-loop system with that of Exercise 12.1. 


13.17 Show that the system 


ti = —1i-c Z2, $9—21—229— Titz bu,  $3— T] + T1T} — 273 


is feedback linearizable and design a state fecdback control law to globally stabilize 
the origin. 


13.18 Consider the system 


$;- 29, £9 =asinz, — bucosz, 


where a and b are positive constants. 
(a) Show that the system is feedback linearizable. 


(b) Using feedback linearization, design a state feedback controller to stabilize the 
system at zı = 6, where 0 € 8 < 7/2. Can vou make this equilibrium point 
globally asymptotically stable? 


13.19 Consider the link manipulator of Example 13.14. Suppose the parameters 
a. b. c. and d are not known exactly, but we know. their estimates à, b, é, and 
d. Design a linearizing state feedback control law in terms of à, b, é, and d and 
represent the closed-loop system as a perturbation of a nominal linear system. 


13.20 Consider a special case of the system (13.37)-(13.38), where fo(7, £) depends 
only on £i, and (A, B) = (Ae, Be) is a controllable canonical form that represents a 
chain of p integrators. Such system is said to be in a special normal form. Assume 
that the origin of 7 = fo(7, 0) is globally asymptotically stable and there is a radially 
unbounded Lyapunov function Vo(7) such that 


A fo(n,0) < -W(n) 


for all 7, where W’(n) is a positive definite function. 
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(a) Show that the control u = a(z) + 6(2)v where A(x) = y~"(2), and the change 
of variables 
zi = êl, 22 = Ez... Zp = EPT Ep, w= EPU 


brings the system into the form 
= fon, 21); EZ = Aez + Bow 
i Let K be chosen such that A, — B.K is Hurvitz and P be the positive definite 


solution of the Lyapunov equation P(A, — B.K) + (A. - BeK) P = ~I. 
Taking w = —Kz and using V (5, 2) = Vo(n) + V2? Pz as a Lyapunov function 


candidate for the closed-loop system, show that, for sufficiently small e, the © 


origin (y = 0, z = 0) is asymptotically stable and the set {V (n, z) € c), with 
an arbitrary c > 0, is included in the region of attraction. 


(c) Show that the feedback control achieves semiglobal stabilization; that is, initial 
states (70, ĉo) in any compact subset of R” can be included in the region of 
attraction. 


(d) In view of Example 13.17, investigate whether the current controller exhibits a 
peaking phenomenon, and if so, explain why is it possible to achieve semiglobal 
stabilization despite the presence of peaking. 


13.21 Consider the system 


dj = tg+2,22-z3+u ‘ 
$9 = 2% 22 -z2 +u 

t3 = zı +t- z- (z3 — zı)? +u 

y = %— 22 


(a) Show that the system has a globally defined special normal form. 

(b) Show that the origin of the zero dynamics is globally asymptotically stable. 
(c) Design a semiglobally stabilizing state feedback control law. 

Hint: See Exercise 13.20. 


13.22 Consider the system (13.44)-(13.45), where A — BK is Hurwitz, the origin 
of ù = fo(n,0) is asymptotically stable, and ||ó(z)] < €. Show that there is a 
neighborhood D of z = 0 and e* > 0 such that for every every z(0) € D and e € e", 
the state z is ultimately bounded by a class K function of e. 


13.23 Consider the system (13.44)-(13.45), where A— BK is Hurwitz, the origin of 
ý = fo(n, 0) is globally exponentially stable, fo is globally Lipschitz, and ||ó|| < k||z|| 
for all z. Show that, for sufficiently small k, the origin z = 0 is globally exponentially 
stable. 
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13.24 Consider the system (13.44)-(13.45), where A — BK is Hurwitz, the origin 
of ù = fo(n,0) is asymptotically stable with a Lyapunov function Vo(7) such that 
[8Vo/An\ fo(n, 0) € —W (n) for some positive definite function W (n). Suppose ||5|| < 
k[||£]| + W()]. Using a composite Lyapunov function of the form V = Vo(n) + 
AVET PE, where P is the solution of P(A — BK) + (A — BK)TP = —I, show that, 
for sufficiently small k, the origin z = 0 is asymptotically stable 


13.25 Consider the system 
i; 25-222, ge=ag3tu, f3=21—-23, yor 


Design a state feedback control law such that the output y asymptotically tracks 
the reference signal r(t) = sint. 


13.26 Repeat the previous exercise for the system 
ti =%2+%18inz}, d9-X122-cu, y=] 


13.27 The magnetic suspension system of Exercise 1.18 is modeled by 


E ii = Z2 
i ES a Loaz2 
2 I- m”? 2m(a + 2)? 
P 1 Loazz3 
is = s |-Rr; +S 
* 0 L(z) BECCES B 


where z, = y, 72 = y, 23 = i, and u = v. Use the following numerical data: 
m = 0.1 kg, k = 0.001 N/m/sec, g = 9.81 m/sec?, a = 0.05 m, Lg = 0.01 H, 
Lı = 0.02 H, and R — 1 Q. 


(a) Show that the system is feedback linearizable. 


(b) Using feedback linearization, design a state feedback control law to stabilize 
the ball at y = 0.05 m. Repeat parts (d) and (e) of Exercise 12.8 and compare 
the pedormanest of this controller with the one designed in part (c) of that 
exercise, 


(c) Show that, with the ball position y as the output, the system is input-output 
linearizable. 


(d) Using feedback linearization, design a state feedback control law so that the 
output y asymptotically tracks r(t) = 0.05 + 0.01sint. Simulate the closed- 
loop system. 
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13. - i 
ts Gre die oe motor is described in Exercise 1,17. When the field 
( source, we can view the field 
input and model the system by the second-order state eds IM 


di = —81zi ems 85x2u +03 
T? = —0423 + 05z1u 
y = £2 


(a) Show that the system is input-output linearizable and has relative degree one 


(b) Show that it is minimum phase. 


(c) Using feedback linearizati i 
cds vis arization, design a PS feedback control to achieve the 


(d) Using computer simulation, study the performance of 


the output of a first-order filter 1/( i 
t Ts + 1) driven by a step command 
The time constant 7 can be chosen to adjust the rate of change of r. In the 


(i) Adjust 7 and , 
Bp the feedback controller parameters to achieve a settling time 


(ii) Adjust r and the f l i 
me eedback controller parameters to achieve a settling 


(iii) Go back to the values used in i 
part (i) and study th fi 
system when the rotor inertia changes by 450%. nani a 


(iv) Can you adjust the feedback controller parameters to improve its robust- 
ness to the parameter perturbations described in the previous part? 


Chapter 14 


Nonlinear Design Tools 


\ 


The complexity of nonlinear feedback control challenges us to come up with system- 
atic design procedures to meet control objectives and design specifications. Faced 
with such challenge, it is clear that we cannot expect one particular procedure to ap- 
ply to all nonlinear systems. It is also unlikely that the whole design of a nonlinear 
feedback controller can be based on one particular tool. What a control engineer 
needs is a set of analysis and design tools that cover a wide range of situations. 
When working with a particular application, the engineer will need to employ the 
tools that are most appropriate for the proble in hand. We have already covered 
several such tools in the earlier chapters. In this chapter, we assemble five nonlinear 
design tools, which are simple enough to be presented in an introductory textbook, 
and practical enough to have been used in real-world problems.! 

In the first two sections, we deal with robust control under the matching condi- 
tion; that is, when uncertain terms enter the state equation at the same point as the 
control input. In the sliding mode control of Section 14.1, trajectories are forced to 
reach a sliding manifold in finite time aud to stay on the manifold for all future time. 
Motion on the manifold is independent of matched uncertainties. By using a lower 
order model, the sliding manifold is designed to achieve the control objective. The 
Lyapunov redesign of Section 14.2 uses a Lyapunov function of a nominal system 
to design an additional control component that makes the design robust to large 
matched uncertainties. Both sliding mode control and Lyapunov redesign produce 
discontinuous controllers, which could suffer from chattering in the presence of de- 
lays or unmodeled high-frequency dynamics. Therefore, we develop "continuous" 
versions of the controllers. In Section 14.1, we use a second-order exainple to ino- 
tivate the main elements of the sliding-inode-control technique, then we proceed 
to present stabilization, tracking, and integral control results. In Section 14.2, we 
show how Lyapunov redesign can he used to achieve stabilization, and introduce 
nonlinear damping— a technique that guarantees boundedness of trajectories even 


lFor more nonlinear design tools. sce [88]. (89], [103], [124], [153], [167]. and [172]. 
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when no upper bound on the uncertainty is known. 

The matching condition can be relaxed via the backstepping technique, intro- 
duced in Section 14.3. Backstepping is a recursive procedure that interlaces the 
choice of a Lyapunov function with the design of feedback control. It breaks a de- 
sign problem for the full system into a sequence of design problems for lower order 
(even scalar) subsystems. By exploiting the extra flexibility that exists with lower 
order and scalar subsystems, backstepping can often solve stabilization, tracking, 
and robust control problems under conditions less restrictive than those encountered 
in other methods. 

Passivity-based control exploits passivity of the open-loop system in the design 
of feedback control. Stabilizing a passive system at an equilibrium point amounts 
to damping injection. In Section 14.4, we describe the basic idea of passivity- 
based control. We also describe feedback passivation-a technique that uses feedback 
control to convert a nonpassive system into a passive one. 

Most of the design tools presented in Chapters 12 through 14 require state 
feedback. In Section 14.5, we introduce high-gain observers, which allow us to 
extend many of those tools to output feedback for a particular class of nonlinear 
systems.” The main idea of Section 14.5 is that the performance under globally 
bounded state feedback control can be recovered by output feedback control when 
the observer gain is sufficiently high. 


14.1 Sliding Mode Control 
14.1.1 Motivating Example 


Consider the second-order system 

ij = 2 

Zo = -h(z)-- g(z)u 
where À and g are unknown nonlinear functions and g(x) > go > 0 for all z. We 
want to design a state feedback control law to stabilize the origin. Suppose we 
can design a control law that constrains the motion of the system to the manifold 
(or surface) s = ajz; + %2 = 0. On this manifold, the motion is governed by 
tı = —ajz,. Choosing a; > 0 guarantees that x(t) tends to zero as t tends to 
infinity and the rate of convergence can be controlled by choice of a). The motion 
on the manifold s = 0 is independent of h and g. How can we bring the trajectory 
to the manifold s = 0 and maintain it there? The variable s satisfies the equation 

å = aż + £9 = ay zo + h(x) + g(z)u 
Suppose h and g satisfy the inequality 
atz + A(x) 
g(z) 
2Other output feedback control tools are described in Exercises 14.47 through 14.49. 
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for some known function o(z). With V = (1/2)s? as a Lyapunov function candidate 
for § = 24125 + h(x) + g(z)u, we have 


V=ss= s[a122 + h(z)] + g(z)su < g(z)lslo(z) + g(z)su 


Taking 
u = —f(x) sgn(s) 
where A(x) > o(z) + Bo, Bo > 0, and 


1, s>0 
sgn(s) = 0, s=0 
-i, s<0 


yields 


V < g(z)lele(z) — o(z)le(z) + &o]s sgn(s) = —9(z)Bols| < —9o5ols| 
Thus, W = VV = |s| satisfies the differential inequality 
D*W < -gobo 


and the comparison jemma shows that 
W(s(t)) < W(s(0)) — gofot 


"Therefore, the trajectory reaches the manifold s — 0 in finite time and, once on 
the manifold, it cannot leave it, as seen from the inequality V < —2goflo|s]. In 
summary, the motion consists of a reaching phase during which trajectories starting 
off the manifold s = 0 move toward it and reach it in finite time, followed by a 
sliding phase during which the motion is confined to the manifold s — 0 and the 
dynamics of the system are represented by the reduced-order model tı = —a1T1. A 
sketch of the phase portrait is shown in Figure 14.1. The manifold s = 0 is called 
the sliding manifold and the control law u = —fi(z) sgn(s) is called sliding mode 
control. The striking feature of sliding mode control is its robustness with respect 
to h and g. We only need to know the upper bound o(z) and during the sliding 
phase, the motion is completely independent of h and g. 

The sliding mode controller simplifies if, in some domain of interest, h and g 
satisfy the inequality 
0122 + h(x) 

g(z) 


for some known nonnegative constant. kj. In this case, we can take 


Sky 


—-ksgn(s), k»h 
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Figure 14.1: A typical phase portrait under sliding mode control. 


€ bus the form of a simple relay. This form, however, usually leads to a finite 
gion o attraction, which can be estimated as follows: The condition s3 € 0 in the 
set (|s| € c) makes it positively invariant. From the equation 3 


£) = 29 = —-a,2, +8 


and the function V; = (1/2)x?, we have 
Vi = 21h) = —a127 + T18 S —ayz? + [eije <0, Vini = 
ay 


Thus, 
la(0)) € — 2 ln(t)) «& +, vt>0 
Q1 a € 


and the set 
a= [Inl s =, se} 
a1 
sketched in Figure 14.2, is positively invariant if 


0172 + h(x) 
——Á——I« 
"e |s&, Vaen 


ain every trajectory starting in 2 approaches the origin as £ tends to infinity. 

s dh ee T: eium any compact set in the plane can be made a subset 
2. Therefore, if k can be chosen arbitrarily large, the foregoin t 

achieve semiglobal stabilization. unc aite 

Konrad of imperfections in switching devices and delays, sliding mode control 

E ers from chattering. The sketch of Figure 14.3 shows how delays can cause 

chattering. It depicts a trajectory in the region s > 0 heading toward the sliding 


ca 
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s=0 


Figure 14.2: Estimate of the region of attraction. 


Sliding manifold 


Figure 14.3: Chattering due to delay in control switching. 


manifold s = 0. It first hits the manifold at point a. In ideal sliding mode control, 
the trajectory should start sliding on the manifold from point a. In reality, there 
will be a delay between the time the sign of s changes and the time the control 
switches. During this delay period, the trajectory crosses the manifold into the 
region s < 0. When the control switches, the trajectory reverses its direction and 
heads again toward the manifold. Once again it crosses the manifold, and repetition 
of this process creates the “zig-zag” motion (oscillation) shown in the sketch, which 
is known as chattering. Chattering results in low control accuracy, high heat losses 
in electrical power circuits, and high wear of moving mechanical parts. It may also 
excite unmodeled high-frequency dynamics, which degrades the performance of the 
system and may even lead to instability. 


To get a better feel for chattering, we simulate the sliding mode control of the 
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Figure 14.4: Ideal sliding mode control. 


pendulum equation 


$j = t? 
i, = —(go/é)sin(x1 + 61) — (Ko/m)za + (1/m£)u 
u = —ksgn(s) = —ksgn(aizy + 22) 


to stabilize the pendulum at 6; = 7/2, where zı = 9— ô, and x2 = 6. The constants 
m, £, ko, and go are the mass, length, coefficient of friction, and acceleration due to 
gravity, respectively. We take a) = 1 and k = 4. The gain k = 4 is chosen by using 


azz + h(z) 


a |Z (m — ko)za — mot cos(s1)| 


IA 


£|m — kol(2r) + mgo£ < 3.68 


where the bound is calculated over the set (|zi| € m, |£1 + z2| < 7) for 0.05 < 
m < 0.2, 0.9 < £ € 1.1, and 0 € ko < 0.05. The simulation is performed by using 
m = 0.1, £ = 1, and kọ = 0.02. Figure 14.4 shows ideal sliding mode control, 
while Figure 14.5 shows a nonideal case where switching is delayed by unmodeled 
actuator dynamics having the transfer function 1/(0.01s + 1)?. 

We will present two ideas for reducing or eliminating chattering. The first idea 
is to divide the control into continuous and switching components so as to reduce 


the amplitude of the switching one. Let h(x) and (x) be nominal models of h(x) 


and g(x), respectively. Taking 
MCCERSON 


ae) 
results in 
ia. h Z ga] HENE EE) hla) + g(a)  à(z) + g(z)v 
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Figure 14.5: Sliding mode control with unmodeled actuator dynamics. 


If the perturbation term ó(z) satisfies the inequality 


êle) 


"S < e(z) 


we can take '. 


v = —f(z) sgn(s) 


where A(x) > o(z)-- fo. Because p is an upper bound on the perturbation term, it is 
likely to be smaller than &n upper bound on the whole function. Consequently, the 
amplitude of the switching component would be smaller. For example, returning 
to the pendulum equation and taking 7 = 0.125, £ = 1, ko = 0.025 to be nominal 
values of m, £, kg, we have 


ó 
"e |(a me = amn? — ko? + fol?) Z2 — go(m£ — hi) cosg € 1. 83 


where the bound is calculated over the same set as before. The modified sliding 
mode control is taken as 


u = —0.1z2 + 1.2263 cos z; — 2 sgn(s) 


which shows a reduction in the switching term amplitude from 4 to 2. Figure 14.6 
shows simulation of this modified control in the presence of unmodeled actuator 
dynamics. The reduction in the amplitude of chattering is clear. 

The second idea to eliminate chattering is to replace the signum function by a 
high-slope saturation function; that is, the control law is taken as 


u = —fl(x) sat (3) 
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Figure 14.7: The signum nonlinearity and its saturation function approximation. 


where sat(-) is the saturation function defined by 


V if |y € 1 
sat(y) = 
sgn(y), if |y| 5 1 


and € is a positive constant. The signum and saturation functions are shown in 

“Figure 14.7. The slope of the linear portion of sat(s/e) is 1/e. Good approximation 
requires the use of small e. In the limit, as € — 0, the saturation function sat(s/e) 
approaches the signum function sgn(s). To analyze the performance of the “contin- 
uous” sliding mode controller, we examine the reaching phase by using the function 
V = (1/2)s? whose derivative satisfies the inequality 


V € -goBols| 


wen o E v - 
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when |s| > e; that is, outside the boundary layer {|s| € €}. Therefore, whenever 
[s(0)| > e, |s(é)] will be strictly decreasing. until it reaches the set {|s| € e} in finite 
time and remains inside thereafter. Inside the boundary layer, we have 


iy = aT] +s 


where |s| < £. The derivative of V; = (1/2)r? satisfies 
€ 


Y= =at? + xis € ar? + rile € - (1. 6;)a, 22, V lal 2 ? 
: q1U1 


where 0 < 6; < 1. Thus, the trajectory reaches tlic set Ne = {|z1| € €/(a161), |s| € 
€) in finite time. In general, we do not stabilize the origin, but we achieve ultimate 
boundedness with an ultimate bound that can be reduced by decreasing e. What 
happens inside Qs is problem dependent. Let us consider again the pendulum 
equation and see what happens inside ©, in that case. Inside the boundary layer 
{|s| € €}, the control reduces to the linear feedback law u = —ks/e, and the closed- 
loop system 


ij = Ir? 


—(go/€) sin(z; + 61) — (kg/m) x2 — (k/mP'e)(asz; + 22) 


i2 
has a unique equilibrium point at (z1,0), where Z, satisfies the equation 
emgoé sin(Z + 61) + ka,%, — 0 


and can be approximated for small € by z; ~ —(emgoé/ka,)sind,. Shifting the 
equilibrium point to the origin by the change of variables 


y1-zi-— 2). yo 22 


results in 


y 
ko k 
Ye = -e(w)- (= + zu: ya 
where 
e (41) = (go/€)[sin(ys + Zi F ô1) — sin(Z; + ô1)] + (ka, / ml €) 
Using 


E yı 
V= n a(s) ds + (1/22 
0 
as a Lyapunov function candidate, it can be verified that 


V > -(go/20)y? + (kaj/2m?:)yi + (1/2)? 
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Figure 14.8: "Continuous" sliding mode control. 
is positive definite for (k/e) > (m£go/a1) and its derivative satisfies 


Application of the invariance principle shows that the equilibrium point (Z1,0) is 
asymptotically stable and attracts every trajectory in Qe. 

For better accuracy, we need to choose € as small as possible, but a too small 
value of e will induce chattering in the presence of time delays or unmodeled fast 
dynamics. Figure 14.8 shows the performance of the “continuous” sliding mode 
controller when applied to the pendulum equation for two different values of £. 
Figure 14.9 shows the performance in the presence of the unmodeled actuator 
1/(0.01s + 1). The striking observation here is that, while reducing € improves 
accuracy in the ideal case, it may not have the same effect in the presence of delays 
due to chattering. 

One special case where we can stabilize the origin without pushing £ too small 
arises when h(0) — 0. In this case, the system, represented inside the boundary 
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Figure 14.9: "Continuous" sliding mode control with unmodeled actuator dynamics. 


layer by 


$i = 2% 


$9 = h(z)- ES (a1z1 + z2) 


has an equilibrium point at the origin. We need to choose € small enough to stabilize 
the origin and make N, a subset of its region of attraction. For the pendulum 
equation with 6, = 7, repeating the foregoing stability analysis confirms that we 
can achieve our goal if k/e > mgof/a,. For £ € 1.1, m < 0.2, k = 4 and a; = 1, we 
need € < 1.8534. Figure 14.10 shows simulation results for € = 1. 

If ô is any angle other than 0 or m (the open-loop equilibrium points), the 
system will stabilize at an equilibrium point other than the origin, leading to a 
steady-state error, which was approximated earlier by (emgo£/ka;) sinô. We can 
still achieve zero steady-state error by using integral action. Let tp = f zı and 
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Figure 14.10: "Continuous" sliding mode control when ô; = 7. 


write the augmented system as 


do = z 
$1 = 3 
i = -(go/Ü)sin(zi + &i) — (ko/m)za + (1/mé?)u 


Take 5 = aozo + a121 + x2, where the matrix 


is Hurwitz. If 
m |aozi + a22 — (go/) sin(zi + 41) — (Ko/m)za| < hy 
over the domain of interest, we can take the "continuous" sliding mode control as 
u= -k sat (=), k>k 
which ensures that s will reach the boundary-layer {|s| € €} in finite time, since 
så < -(k—ky)s, for |s| > € 


Inside the boundary layer, the system is represented by 
y= _ | 70 _| 0 
ù = Aon + Bos, where [z| 5-1 


Taking V; = n” Pon, where Py is the solution of the Lyapunov equation Py Ag + 
AoPT = —I, it can be verified that 


Vy = =? + W R Bos < -01 = Miil, V Ulla 2: 21 Po Bollas/0: 
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Figure 14.11: "Continuous" sliding mods control with integral action when à; = 7/2 . 


where 0 < 04 < 1. Thus, all trajectories reach the set 


Al] P5.Bol[22? || 
a = (vi) « TA, c 
1 


in finite time. Inside Qe, the system 


$9 = 2 
di = T2 
$2 =  —(go/Ü)sin(zi 4-61) — (ko/m)za — (k/mée)(aoru cai; + 22) 


has a unique equilibrium point at Z = [—(emgo/kao)sin 6, 0, 0|T. Repeating 
the previous stability analysis, it can be shown that for sufficiently small € the 
equilibrium point Z is asymptotically stable and every trajectory in R, converges 
to Z as t tends to infinity. Hence, 8 converges to the desired position 6). Simulation 
results for m = 0.1, £ 2 1, ko = 0.02, 6) = 7/2, ag = a; = 1, k = 4, and € = 1 are 
shown in Figure 14.11. 


14.1.2 Stabilization 
Consider the system 
å = f(x) + B(x)|G(z)E(z)u + 6(t, 2, u)| (14.1) 


where z € R” is the state, u € RP is the control input, and f, B, G, and E 
are sufficiently smooth functions in a domain D C R” that contains the origin. 
The function 6 is piecewise continuous in ¢ and sufficiently smooth in (z,u) for 
(t,x, u) € (0, oc) x D x RP. We assume that f. B, and E are known. while G and 


a RA ix r . 
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6 could be uncertain. Furthermore, we assume that E(x) is a nonsingular matrix 

and G(z) is a diagonal matrix whose elements are positive and bounded away from 

zero; that is, gí(z) > go > 0, for all z € D. Suppose f(0) = 0 so that, in the 

absence of 6, the origin is an open-loop equilibrium point. Our goal is to design a 

state feedback control law to stabilize the origin for all uncertainties in G and 6. 
Let T : D — R” be a diffeomorphism such that : 


oT 0 e 
25 = 4.2 
Bae] (14.2) 
where 7 is the p x p identity matrix.’ The change of variables 
| : | -T(r, q€ R”, £e RP (14.3) 
transforms the system into the form 
ġ = faln, €) (14.4) 
E = fe(n €) + G(z) E(z)u + d(t,z,u) (14.5) . 


The form (14.4)-(14.5) is usually referred to as the regular form. To design the 
sliding mode control, we start by designing the sliding manifold s = € — ¢(n) = 0 
such that, when motion is restricted to the manifold, the reduced-order model 


= falm d(n)) (14.6) 


has. an asymptotically stable equilibrium point at the origin. The design of ¢(n) 
amounts to solving a stabilization problem for the system 


q= faln, €) 


with € viewed as the control input. This stabilization. problem may be solved by 
using the techniques of linearization or feedback linearization presented in the pre- 
vious two chapters or some nonlinear design tools that will be introduced later in 
this chapter, such as backstepping or passivity-based control. We assume that we 
can find a stabilizing continuously differentiable function ¢(n) with $(0) = 0. Next, 
we design u to bring s to zero ‘in finite time and maintain it there for all future 
time. Toward that end, let us write the s-equation: 


ie fn £) - Fe faln, £) + G(x) E(z)u + ôl, x,u) (14.7) 


As we saw in the introductory example, we can design u as a pure switching compo- 
nent. or it may contain an additional continuous component that cancels the known 


3The method can be extended to the case where G is not diagonal by including the off-diagonal 
elements in 6. Since the dependence of 6 on u will he restricted, the method works for cases where 


G is diagonally dominant. 
''T'he existence of T is explored in Exercise 14.9. 
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terms on the right-hand side of (14.7). If G(x) is a nominal model of G(x), the 
continuous component of u will be — E^ *G-![f, —(86/01) fa]. In the absence of un- 
certainty; that is, when ô = 0 and G is known, taking u = -E-1G^![fy - (09/89) fal 
results in 3 — 0, which ensures that the condition s — 0 can be maintained for all 
future time. To analyze both cases simultaneously, we write the control u as 


u = E7!(z) f-ra) [ana - ose J + J (14.8) 


where L(x) = G-!(z), if the known terms are cancelled, and L = 0, otherwise. 
Substituting (14.8) into (14.7) yields 

3i = gi(z)vi + A(t, 2, v), 1 < i < p (14.9) 
where Aj is the ith component of 


A(tz,v) = $(tz,—E"'(z) L(z)s(n, £) — (00/00) falh £)) + E ()v) 
+ [I~ G(z)L()] [fst £) — (86/8n) faln, €)] 


and E is the ith diagonal element of G. We assume that the ratio A; /9; satisfies 
the inequality 
E x,u) 
gi(z) 
where o(z) 2 0 (a continuous function) and xo € [0, 1) are known. Using the 


estimate (14.10), we proceed to design v to force s toward the manifold s = 0. 
Utilizing V; = (1/2)s? as a Lyapunov function candidate for (14.9), we obtain 


Sglz)+rollel V (t,2,) € (0,00) x Dx FP, W1<i<p (14.10) 


Vi = 918; = sigi(z)vi + 3,A;(t, 2, v) < gi(z)tsivi + |3;|[0(z) + &ollvlles]) 
Take® 


v; —-Ó(z)sgn(s)) 1<i<p (14.11) 
where ' 
a(z)> S 44, vigp (14.12) 


l- Kp 
and fy > 0. Then, 


Vi S eG)[-B(z) + ofa) + of (lle = sm) - (1 — no)B(z) + ez)]lsd 
X g(z)-e(z) — (1 — &o)&o + e(z)]ls] € —gofs(1— Ko)|3;| 


The inequality Ws ~90Bo( 1 — &o)|s;| ensures that all trajectories starting off the 
manifold s = 0 reach it in finite time and those on the manifold cannot leave it. 
The procedure for designing a sliding mode stabilizing controller can be sum- 
marized by the following steps: à ] 
The continuous component is usually referred to as the equivalent control. 


6p, : : ; 
For convenience, we take the coefficient of the signum function to be the same for all control 


components. See Exercise 14.12 for a relaxation of this restriction. 


| 
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e Design the sliding manifold € = $(7) to stabilize the reduced-order system 
(14.6). 


e Take the control u.as u — E-M- 6-1, — (86/0) fa] + v) or u = E7lv. 


e Estimate g(x) and «g in (14.10), where A depends on the choice made in the 
previous step. 


o Choose (x) that satisfies (14.12) and take the switching (discontinuous) con- 
trol v as given by (14.11). 


This procedure exhibits model-order reduction because the main design task is per- 
formed on the reduced-order system (14.6). The key feature of sliding mode control 
is its robustness to matched uncertainties. During the reaching phase, the task 
of forcing the trajectories toward the sliding manifold and maintaining them there 
is achieved by the switching control (14.11), provided A(z) satisfies the inequality 
(14.12). From (14.10), we see that g(x) is a measure of the size of the uncertainty. 
Since we do not require g(x) to be small, the switching controller can handle fairly 
large uncertainties, limited only by practical constraints on the amplitude of the 
control signals. During the sliding phase, the mótion of the system, as determined 
by (14.6), is independent of the matched uncertain terms G and 6. l 

The sliding mode controller contains the discontinuous signum function sgn(s;), 
which raises some theoretical as well as practical issues. Theoretical issues like 
existence and uniqueness of solutions and validity of Lyapunov analysis will have to 
be examined in a framework that does not require the state equation to have locally 
Lipschitz right-hand-side functions." There is also the practical issue of chattering 
due to imperfections in switching devices and delays, which was illustrated in the 
introductory example. To eliminate chattering, we use a continuous approximation 
of the signum function.? By using a continuous approximation, we also avoid the 
theoretical difficulties associated with discontinuous controllers. We approximate 
the signum function sgn(s;) by the high-slope saturation function sat(s;/e);!° that 
is, 


vi = —B(x) sat (3) ; lsis<p (14.13) 


where p(x) satisfies (14.12). To analyze the performance of the “continuous” sliding 
mode controller, we examine the reaching phase by using the Lyapunov function 


TTo read about differential equations with discontinuous right-hand side, consult [58], [147], 
[173], and [198]. . 

30ther approaches to eliminate chattering include the use of observers [197] and extending 
the dynamics of the system by using integrators [177]. It should be noted that the continuous 
approximation approach cannot be used in applications where actuators have to be used in an 
on-off operation mode, like thyristors, for example. 

9While we do not pursue rigorous analysis of the discontinuous sliding mode controller, the 
reader is encouraged to use simulations to examine the performance of both the discontinuous 
controller and its continuous approximation. 

Y*8mooth approximations are discussed in Exercises 14.11. 
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V; = (1/2)s?. The derivative of V; satisfies the inequality 
V < ale) [-A(2)5; sat (3) atl + obs 
In ie region |s;| > £, we have 
Vi € gi(z)[-(1 — &o)A(z) + e(x)]|ss € —go&o(1 — &o)]sil 


which shows that whenever |s;(0)| > e. [s;(£)| will decrease until it reaches the set 
(lsi| € €} in finite time and remains inside thereafter. The set (|s| <€, 1€ i € p) 
is called the boundary layer. To study the behavior of 7, we assume that, together 
with the sliding-manifold design € = ¢(n). there is a (continuously differentiable) 
Lyapunov function V (n) that satisfies the inequalities 


ax (In|) € V(n) < ex(linil) (14.14) 


T mams) con, Vln vil) (1415 
for all (5,£) € T(D), where a1, a2, as; and y are class K functions. Noting that 
\si| £e fr 1 <i<p => lsl € ice V € —os(linll). for Iinl] 2 66e) 
for some positive constant k;,!? we define a class K function a by 

a(r) = a2(y (kir) 
Then, 


V(g) zalc) > V(n) > aa2(y(kic)) = ex(Ilnll) 2 e2((06) 
=> nl > (kc) = V < -es(Inl) € -es(9) 


which shows that the set {V(7) < co) with co > a(c) is positively invariant because 
V is negative on the boundary V(7) = co. (See Figure 14.12.) Jt follows that the 


set . 
2 ={V(n) € co} x (ls| Se, 1 i <p}, with co 2 a(c) (14.16) 


is positively invariant whenever c > € and Q C T(D). Choose €, c > £, and Co z alc) 
such that Q c T(D). The compact set N serves as our estimate of the "region of 
attraction.” For all initial states in 9, the trajectories will be bounded for all ¢ > 0. 
After some finite time, we have |s;(t)| < £. It follows from the foregoing analysis 
that V € —a3(7(kie)) for all V(n) 2 a(e). Hence, the trajectories will reach the 
positively invariant set : 


EH 


e ={V(n) < a(e)} x {sil se 1 <i <p} (14.17) 


as Pana aR ine ps SD ico D A r 
Inequality (14.15) implies local input-to-state stability of the system 7) = fa(1, 6() + 5) when 
s is viewed as the input. (See Exercise 4.60.) . : 
12The constant kı depends on the type of norm used in the analysis. 


-— 
-— 


3 


CORRER YKRERREKEKKEFEEEEKWVEFEEKKKERFRERERKEFKTF KK 


X 


ma 
i 


-— 


V A 


4 


PAI AA A AAA AAP AI PU BPS A A a a 


AR, BBL 


a NEA o 2 


Á a - 


568 CHAPTER 14, NONLINEAR DESIGN TOOLS 


Figure 14.12: A representation of the set Q for a scalar s. V < 0 above the a(-)-curve. 


in finite time. The set Ne can be made arbitrarily small by choosing £ small enough. 
In the limit, as € — 0, Qe shrinks to the origin, which shows that the “continuous” 
sliding mode controller recovers the performance of its discontinuous counterpart. 
Finally, we note that if all the assumptions hold globally and V(n) is radially un- 
bounded, we can choose f? arbitrarily large to include any initial state. We summa- 
rize our conclusions in the next theorem. 


Theorem 14.1 Consider the system (14.4)-(14.5). Suppose there exist (n), V(n), 
olz), and Ko, which satisfy (14.10), (14.14), and (14.15). Let u and v be given by 
(14.8) and (14.11), respectively. Suppose £, c > €, and co > a(c) are chosen such 
thai the set 2, defined by (14.16), is contained in T(D). Then, for all (n(0),€(0)) € 
NQ, the trajectory (n(t),€(t)) is bounded for all t 2 0 and reaches the positively 
invariant set Ne, defined by (14,17), in finite time. Moreover, if the assumptions 
hold globally and V(n) is radially unbounded, the foregoing conclusion holds for any 


initial state. © 


The theorem shows that the “continuous” sliding mode controller achieves ul- 
timate boundedness with an ultimate bound that can be controlled by the design 
parameter e. It also gives conditions for global ultimate boundedness. Since the 
uncertainty ó could be nonvanishing at z = 0, ultimate boundedness is the best we 
can expect, in general. If, however, 6 vanishes at the origin, then we may be able 
to show asymptotic stability of the origin, as we do in the next theorem. 


Theorem 14.2 Suppose all the assumptions of Theorem 14.1 are satisfied with 
o(0) = 0 and ko = 0. Suppose further that the origin of ù = fa(n, (n)) is expo- 
nentially stale. Then, there exits e* > 0 such that for all 0 < e < e*, the origin 
of the closed-loop system is exponentially stable and (1 is a subset of its region of 
attraction. Moreover, if the assumptions hold globally, the origin will be globally 
uniformly asymptotically stable. ; o 
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Proof: For inequality (14.10) to hold with ao = 0. A, must be independent of 
v. Therefore, we write A; = A;(t, £). Theorem 14.1 confirms that all trajectories 
starting in Q enter Ne in finite time. Inside Ne, the closed-loop system is given by 


falm oln) + s) 


7 


By (the converse Lyapunov) Theorem 4.14, there exists a Lyapunov function Vo(n) 
that satisfies 
eilini < Yola) < collnll3 


0Vs 2 
By felts 0) < ~ell 
Vo 
| IE < eaa 
in some neighborhood N, of 7 = 0. By the smoothness of fa and A and the fact 
that |A; (t, £)| € g:(£)o(x) with o(0) = 0, we have 
Ilfa(n, (n) + 8) — faln: $())ll2 S killsll2 


i lAll2 S Kallnlla + Ksllslla 


in some neighborhood N of (5,£) = (0,0). Choose £ small enough that Q, C N, 
and 2, C N. Using the Lyapunov function candidate : 


P 
W =Vo(n) +3087 


i=] 


it can be shown that 
W < -eslnlf + caki rnloliella + kalinllzllslle + Falls — 22 ol 


The right-hand side can be made negative definite in 2, by choosing £ small enough. 
The rest of the proof is straightforward. n 


The basic idea of the foregoing proof is that, inside the boundary layer, the 
control v; = —f(x)s;/e acts as high-gain feedback control for small £. By choosing 
€ small enough, the high-gain feedback stabilizes the origin. We could have used 
the high-gain feedback control throughout the space, but the control amplitude will 
be too high when s is far from zero. 

We have emphasized the robustness of sliding mode control with respect to 
matched uncertainties. What about unmatched uncertainties? Suppose equation 
(14.1) is modified to 


i = f(x) + B(z)G(z)E(z)u + ó(t, z, u)] + ô1 (z) (14.18) 
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The change of variables (14.3) transforms the system into 


faln, £) + ós (n, €) 
fo(n, €) + G(z) E(x)u + 5(t, 2, u) + (n, €) 


ôa | OT 5 
& | dx! 
The term 6, is added to the matched uncertainty 6. Its only effect is to change the 


upper bound on A;/g;. The term ĝa, on the other hand, is unmatched. It changes 
the reduced-order model on the sliding manifold to 


= fa(n, O(n) + 5 (n, 6(n)) 


The design of $ will have to guarantee asymptotic stability of the origin 7 = 0 in 
the presence of the uncertainty ó,. This is a robust stabilization problem that may 
be approached by other robust stabilization techniques such as high-gain feedback. 
The difference between matched and unmatched uncertainties is that sliding mode 
control guarantees robustness for any matched uncertainty provided an upper bound 
is known and the needed control effort can be provided. There is no such guarantee 
for unmatched uncertainties. We may have to restrict its size to robustly stabilize 
the system on the sliding manifold. The next two examples illustrate these points. 


i 
é 


where 


Example 14.1 Consider the second-order system 


$i = £2+0,2,sinzq 
0223 +21+4u 


£2 


where 0; and 62 are unknown parameters that satisfy |@,| < a and 102] < b for some 
known bounds a and b. The system is already in the regular form with 7 = x, and 
€ = 15. Uncertainty due to 65 is matched, while uncertainty due to 6, is unmatched. 
We consider the system 

fy = T2 + 01i Sin 12 


and design x2 to robustly stabilize the origin zı = 0. This can be achieved with 
z2 = —kzi, k > a, because 


zd, = —hzj + 0z? sin(—ks1) € —(k — a)z] 
The sliding manifold is s = T2 + kzı = 0 and 
$= 6223 +2, +u + k(x2 + 4,2; sin z2) 


To cancel the known term on the right-hand side, we take 


u= -T — kta + 
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to obtain 


D 


$-v-A(z) 
where A(x) = 6973 + k612, sin za. Because 
lA(z)I < aklzi[ + bz? 
we take 
p(z) = ak|xi|-- br3 + Bo, — £9 50 


and 
u = —T; — kra — f(x) sgn(s) 


This controller, or its continuous approximation with sufficiently small £, globally 
stabilizes the origin. A 


In the foregoing example, we were able to use high-gain feedback to robustly stabilize 
the reduced-order model for unmatched uncertainties that satisfy |0;| € a, without 
having to restrict a. In general, this may not. be possible, as illustrated by the next 
example. 


Example 14.2 Consider the second-order system 


zi + (1—61)22 
brz +, +u 


l 


ii 


£2 


where 0, and 65 are unknown parameters that satisfy |0;| € a and |02| € b. We 
consider the system 
ii =27+ (1 — 01)12 


and design zz to robustly stabilize the origin x; = 0. We note that the system 
is not stabilizable at 0; = 1. Hence. we must liinit a to be less than one. Using 
z2 = —kz, we obtain 


zii; = z2 — k(1— 61)27 € —[k(1 — a) - 1]z1 
Hence, the origin x, = 0 can be stabilized by taking k > 1/(1— a). The sliding 
manifold is s = z2 + kx, = 0. Proceeding as in the previous example, we end up 


with the sliding mode control 


u = —(1-F k)zi — kzz — B(x) sgn(s) 


where 3(r) = br? + ak|r2| + o with By > 0. . A 


AAAAC 
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14.1.3 Tracking 
Consider the single-input-single-output system 


i f(x) + éi(z) + g(x) lu + ô(t, 2, u)] 
y = h(z) 


where z, u, and y are the state, control input, and controlled output, respectively. 
We assume that f, g, h, and 6) are sufficiently smooth in a domain D c £^ 
and 6 is piecewise continuous in £ and sufficiently smooth in (x,u) for (t, z,u) € 
[0, co) x D x R. Furthermore, we assume that f and h are known, while g, ô, and ô, 
could be uncertain. For all possible uncertainties in g, we assume that the system 


(14.19) 
(14.20) 


I 


t = f(z)-4g(r)u (14.21) 
= A(z) (14.22) 
has relative degree p in D; that is, 
L,h(z) 5. = L,L7 ^h(z) 0, LoL h(s) 2a» 0 


for all z € D.!? Our goal is to design a state feedback control law such that the 
output y asymptotically tracks a reference signal r(t), where 


e r(t) and its derivatives up to r(^ (t) are bounded for all t > 0, and the pth 
derivative r‘)(t) is a piecewise continuous function of t; 


e the signals r,... ,r(^) are available on line. 


We know from our study of input-output linearization (Section 13.2) that the 
system (14.21)-(14.22) can be transformed into the normal form by the change of 
variables 


o1(z) 
n olz) $n-p(2) 
--~ }/=]---]J= iE = T(z) (14.23) 
3 EO h(z) 
; L4 h(z) 
where $1 to Ọn—p satisfy the partial differential equations 
Obi yy 
a; 0) = 9 folc&i£n-p,VzcD 


13 Without loss of generality, we assume that LjL5 !h is positive. If it is negative, we can 
substitute u = —ü and proceed to design &. Thus, by solving the problem for a positive Lg Lf 'h, 


we can cover both signs by multiplying the control by sign(Lg L7 ! h). 


iori AS lbs 
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We assume that T(z) is a diffeomorphism over D. Since f and h are known, while 
g could be uncertain, the function y is known, while $ could be unknown. We 
would like to restrict the perturbations ô and 6, such that when the change of 
variables (14.23) is applied to the perturbed system (14.19)-(14.20) it preserves the 
normal form structure. From the relative-degree condition, it is clear that the state 
equation for 7 will be independent of u. Let us calculate the state equation for € 


L 


; _ Oh ðh 
a= EU +ô, +g(u + ô)] = az; + 4) 
If à belongs to the null space of [Gh/Oz]; that is, [8h/8x]ói (x) = 0, for all z € D, 
we have 
& = Lrh(z) = & 
Similarly, 
: O(Lgh 
fy = POI + 5, t glu + 0) = EAs 4 4) 
If 6, belongs to the null space of [8(L;h)/8z] for all z € D, we have 


& = Ljh(z) = &. 
Continuing in the same manner, it can be seen that if 


O(LÀh) . ; 
" Dn éi(z)=0, forlsi<p-2, VreD (14.24) 
then the change of variables (14.23) produces the normal form 
)? = fo(n, é) 
& = & 
65-1 = Ep 
Go = Lyh(z) + Ls, L h(E) + LoL h(z)|u + (t, x, u)] 
y= 6 
Let 
T : &-r 
R= : , e= : =f-R 
r(o-1) &, — r(o-1) 
The change of variables e = £ — R yields 
7 = fo(n, £) 
å = e 
Ép-1 = €p 


êp = o Lh(r)- Ls L h(z) + LoL  h(z)[u + d(t, 2, u)] — r^(t) 
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Asymptotic tracking will be achieved if we design a state feedback control law to 
ensure that e(t) is bounded and converges to zero as t tends to infinity. Boundedness 
of e will ensure boundedness of £ because R(t) is bounded. We need also to ensure 
boundedness of y. For that, we restrict our analysis to the case where the system 


ù = fo(n, £) 


is bounded-input-bounded-state stable. This will be the case for any bounded 
input € and any initial state (0) if the system 7) = fo(n, €) is input-to-state stable. 
So, from this point on, we concentrate our attention on showing boundedness and 
convergence of e. The é-equation takes the regular form of (14.4)-(14.5) with m = 
[e,... eoi]? and € = €p. We start with the system 


é) = e 
Èp- = e, 


where £p is viewed as the control input. We want to design e, to stabilize the origin. 
For this linear system (in the controllable canonical form), we can achieve this task 
by the linear control 


Cp = -(kei Tes + kp~1€p-1) 
where kı to k,.. are chosen such that the polynomial 
SP) E bis? poe ki 
is Hurwitz. Then, the sliding manifold is 
s= (kei Tek -1€p-1) t €p =0 
and l 
é= kiez +-+- + ko16p t LAh(z) + La, L^7 h(z) + L,L5  h(z)[u-4- ô(t, 2, u)] —r?(t) 


We can proceed by designing u = v as a pure switching component. or we can take 
1 


u=- LL h(a) [kiez Te kp—1€p + L4h(z) -r^) +v 


to cancel the known terms on the right-hand side, where g(z) is a nominal model 
of g(x). Note that when g is known; that is, when 9 = g, the term 


1 > : 
~ EZCAG) [255 - ^t] 


is the feedback linearizing term we used in Section 13.4.2. In either case, the à- 
equation can be written as 


$= L,U,  h(r)v 4 A(t m. v) 
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Suppose 
A(t, 2, v) 
L,L^  h(z) 


for all (tz, v) € [0, oc) x D x R, where g and «o are known. Then, 


< g(x) + Hole, ÜSko«1 


v = —Ü(r) sgn(s) 


where G(x) > o(z)/(1 — xo) + Bo with Jo > U. aud its continuous approximation is 
obtained by replacing sgn(s) by sat(s/«). We leave it to the reader (Exercise 14.13) 
to show that with the "continuous" slidiug mode controller, there exits a finite 
time 71, possibly dependent on ¢ and the initial states, and a positive constant k, 
independent of £ and the initial states. such that |y(t) — r(t)| < ke for all t > Ty. 


14.1.4 Regulation via Integral Control 


Consider the single-input-single-output system 


È f(x) + (x, w) + g(x, w)[u + (x, u, w)] (14.25) 
y = A(z) (14.26) 


where x € R^ is the state. u € R is the control input, y € R is the controlled 
output. and w € R! is a vector of unknown constant parameters and disturbances. 
The functions f. g. h, 6. and 6, are sufficiently smooth in (x,u) and continuous in 
w for z € D C R”, u € R, and w € D, C fil, where D and Du are open connected 
sets. We assume that the system l 


t = f(x)+g(r.w)u (14.27) 
y h(x) i (14.28) 


has relative degree p in D uniformly in w; that. is, 
Ljh(z,u) = +--+ = LL ^h(r,w) =0, LoL  h(z,w) 2a >0 


for all (z, w) € Dx Dy. Our goal is to design a state feedback control law such that 
the uutput y asymptotically tracks a constant reference r € D. C R, where D, is an 
open connected set. This is a special case of tlie tracking problem of the previous 
section, where the reference is constant and the uncertainty is parameterized by w. 
Therefore, we can use the sliding 1node controller of the previous section. When 
the signum function sgn(s) is approximated by the saturation function sat(s/e). 
the regulation error will be ultimately bounded by a constant ke for some k > 0. 
This is the best we can achieve in a general tracking problem, but in a regulation 
problem, we can use integral control to achieve zero steady-state error. Proceeding 
as in Section 12.3, we augment the integral of the regulation error y — r with the 
system and design a feedback controller that stabilizes the augmented system at an 
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, we assume that, for each pair 


ilibri oint, where y — r. Toward that end 
Files wate i that depends continuously on 


(r,w) € D. x Dy, thete is a unique pair (Tss, Uss) 
(r,w) and satisfies the equations 

0 = f (ss) F ôi (Tss; w) + 9(Tss, w)[uss + (ss, Uss, w)] 

r = h(zss) 
so that z,, is the desired equilibrium point and tss is the steady-state control that 
is needed to maintain equilibrium at Tss. Assuming that 

O(LSh) 

Oz 
the change of variables (14.23) transforms the system (14.25)--(14.26) into the nor- 
mal form 


6(z,w)=0, forl<i<p-2, V (z, w) € Dx Dy 


7 = fo(n, €,w) 
& = & 
p-r = &p : 
& = L^h(z)-* La, L^ !h(z, w) + LL "h(a, w)[u + 6(z, u, w)] 
y= & 


" ; . i. T » 
and maps the equilibrium point Tss into (ns, Ess) where & = [r,0,...,0] . Aug 


menting the integrator 
ép-y-T 


with the foregoing equation and applying the change of variables 


€ &à-r 

£2 [27 
Z =N — ss, e= : = . 

€p 6p 


we obtain the augmented system 


à = fo(z+ es £ w) d lze wr) 


Èo = ĉl 
é) = e 
€p-1 = ep 


é = L^ h(z) + Ls, L^ h(z,w) + LoLG ‘h(a, w)[u + 6(2, u, w)] 


OM Ne Bt eite] Ac IEEE Sx. NODE 
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which preserves the normal form structure with a chain of p+ 1 integrators, ‘There 
fore, the design of sliding mode control can proceed as in the previous section. In 
particular, we can take 


s = kgeg + kiei b kp-1€p-1 + €p 
where ko to kp; are chosen such that the polynomial 
sh + k,-,5^7! +-+ kis + ko 
is Hurwitz. Then, 
è = koei ++: + kp-1€p + LGh(a) + Ls, L h(s, w) + Lo L^  h(z, w)[u + 6(2, u, w)] 


The control u can be taken as 


1 
u=v or u=- LG) [koen + +++ + kp-1€p + L4(z)| Tv 


where §(xr) is a nominal model of g(z, w), to obtain 
$= Ly Lt *h(c, w)v + A(z, v, w,r) 
If 


w A(z,v,u,r) 
L,L  h(z,w) 


for all (z,v,w,r) e Dx Rx Dy x D,, where p and.xp are known, we can take 
s 
v = —p(z) sat (5) 


where A(z) > e(z)/(1 — ko) + fo with o > 0. The closed-loop system has an 
equilibrium point at (z, eg, e) = (0,@,0). Showing convergence to this equilibrium 
point can be done by repeating the analysis of Section 14.1.2. In particular, if there 
is a Lyapunov function V; (z, w,r) for the'system 2 = folz, e, w,r) that satisfies the 
inequalities 


S$ o(z)+Kolv], Oxo «1 


&(lzll) S Valz,w,7) € ã2(llzll) 
OV; = = z 
Hz ewr) <ã), Y Mali = Hllell) 
uniformly in (w,r) for some class K functions à, G2, &3, and Ẹ, we can show that 
there are two compact positively invariant sets Q and 2. such that every trajectory 
starting in Q enters 2, in finite time. The construction of the sets 2 and 2, is done 
in three steps. We write the closed-loop system in the form 


fo(z, e, w,r) 
= AC+Bs 


- (Lj h)B sat (2) +A 


i 


te n~ 
tl 
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where € = [eo,...,e5-1]7 and A is Hurwitz, and use the inequality 
88 < -afs(1— &o)ls], for |s| 2 € 


to show that the set (|s| X c), with c > €, is positively invariant. In the second 
step, we use the Lyapunov function V2(¢) = €T PÇ, where P is the solution of the 
Lyapunov equation PA + ATP = —I, and the inequality 


Vo < ~67¢ + 2ll¢l| IP BI sl 


to show that the set {|s| € c) N {V2 € c?p1) is positively invariant, for some p; > 0. 
Inside this set, we have |lel| < cp, for some p? > 0. Finally, we use the inequality 
V < —ãs(lizl), — V Ilzi = (o2) 
to show that 
N = (ld < c} N {V2 < êm} N {Vi < co} - 
is positively invariant for any co > G2(7(cp2)). Similarly, it can be shown that 
Q, = (ls| < E€} N {V2 S p} n (Vi < Ga(HEp2))} 

is positively invariant and every trajectory starting in Q enters Qe in finite time. 

If z = 0 is an exponentially stable equilibrium point of z = fo(z, e, w, r), we can 
repeat the proof of Theorem 14.2 to show that every trajectory in Qe approaches 
the desired equilibrium point as t — oo. In particular, if V3(z,w,7) is a converse 
Lyapunov function for the exponentially stable origin z — 0, provided by Theo- 
rem 4.14, P is the solution of the Lyapunov equation PA + ATP = —J, and (6,8) 
are deviations of (Ç, s) from their equilibrium values, then it can be shown that the 
derivative of "n 

Vo = Va ACT PC + 18 

with A > 0, satisfies the inequality 


l izl T^ [ k -k3 -ka zl 
Vo S — | icll —ks À —(Aks + ks) | | Ii¢lle 
ll ~kg — (Aks + ke) (k2/€) — k7 l| 

where k, and kz are positive constants, while ka through k7 are nonnegative con- 
stants. The derivative Vo can be made negative definite by choosing A > k2/k; and 
then choosing ¢ small enough to make the 3 x 3 matrix positive definite. 

In the special case when £ = k (a constant) and u = v, the "continuous" sliding 
mode controller is given by 

= —k sat (Emtec verte citer se) (14.29) 
A l 

When p = 1, the controller (14.29) is a classical PI controller followed by saturation 
(Figure 14.13), and when p = 2, it is a classical PID controller followed by saturation 
(Figure 14.14). This is an interesting connection between the “continuous” sliding 
mode controller and these classical controllers. 
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Figure 14.13: The "continuous" sliding mode controller (14.29) for relative-degree-one 


systems: a PI controller with Ky = kkg/e and Kp = k/e, followed by saturation. 


Figure 14.14: The "continuous" sliding mode controller (14.29) for relative-degree-two 
systems: a PID controller with K; = kko/e, Kp = kki/e, and Kp = k/e, followed by 
saturation. 
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(vet SPONG 
14.2.1 Stabilization Sens) 
Consider the system : 
t= f(tz)-4 G(t,z)[u + 6(t, 2, u)] (14.30) 


where x € R” is the state and u € RP is the control input. The functions f, G, 
and 6 are defined for (t, x,u) € [0,00) x D x RP, where D C E" is a domain that 
contains the origin. We assume that f, G, and 6 are piecewise continuous in t and 
locally Lipschitz in x and u. The functions f and G are known precisely, while the 
function ó is an unknown function that lumps together various uncertain terms due 
to model simplification, parameter uncertainty, and so on. The uncertain tern 6 
satisfies the matching condition. A nominal model of the system can be taken as 


è = f(t,z) + G(tz)u (14.31) 


We proceed to design a stabilizing state feedback controller by using this nominal 
model. Suppose we have succeeded to design a feedback control law u = y(t, x) 
such that the origin of the nominal closed-loop system 


z= f(t,z)+G(t,2) p(t, x) (14.32) 
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is uniformly asymptotically stable. Suppose further that we know a Lyapunov 
function for (14.32); that is, we have a continuously differentiable function V(t, x) 


that satisfies the inequalities 


an (ila) < V(t,2) < aa( lla) (14.33) 
Do SEM) + C(t, 2)v(6,2)] < -allel (14.34) 


for all (£, £) € [0,00) x D, where a1, o2, and ag are class K functions. Assume that, 
with u = p(t, £) + v, the uncertain term 6 satisfies the inequality 


et, x, P(t, 2) + o)l] € p(t, 2) + Kollvl], OS Ko <1 (14.35) 


where p : [0,c0) x D — R is a nonnegative continuous function. The estimate 
(14.35) is the only information we need to know about the uncertain term 6. The 
function p is a measure of the size of the uncertainty. It is important to emphasize 
that we will not require p to be small. We will only require it to be known. Our 
goal in this section is to show that with the knowledge of the Lyapunov function 
V, the function p, and the constant «go in (14.35), we can design an additional 
feedback control v such that the overall control u = w(t, x) + v stabilizes the actual 
system (14.30) in the presence of the uncertainty. The design of v is called Lyapunov 
redesign. 

Before we carry on with the Lyapunov redesign technique, let us illustrate that 


the feedback linearization problem of the previous chapter fits into the framework 


of the current problem. 
Example 14.3 Consider the feedback linearizable system 
t = f(r) +G(zr)u 

where f : D — R” and G : D + R”*? are smooth functions on a domain D c R” 
and there is a diffeomorphism T : D — R” such that D, = T(D) contains the origin 
and T(z) satisfies the partial differential equations 

ôT 

SHE) = ATG) - Br(z)a(2) 


Tale) = Byla) 


where (A, B) is controllable and y(x) is nonsingular for all z € D. The change of 
variables z = T(z) transforms the system into the form 


z= Az + By(z)[u — a(z)] 
Consider also the perturbed system 


z= f(z) + Ag(x) + [G(z)  Ac(x)]u 


oe D 


re Ln 
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with smooth perturbations that satisfy the conditions 


Fe Aste) = By(a)As(2), Acla) = G(e)Aala) 


on D, The perturbed system can be represented in the form (14.30); that is, 
à = Az — By(z)a(zr) + Ba(z)[u + ó(z, u)] á 


where 6(z, u) = A1 (x) + Az(z)u. Since the nominal system is feedback linearizable, 
we can take the nominal stabilizing feedback control as 


p(z) = a(z) - 3^ (z)Kz = a(z) - Y (z)KT() 


where K is chosen such that (A — BK) is Hurwitz. A Lyapunov function for the 
nominal closed-loop system 
z=(A-BK)z 


can be taken as V(z) = 27 Pz, where P is the solution of the Lyapunov equation 
P(A- BK)+(A-BK)'’P=-I 
With u = v(z)'4- v, the uncertain term ô (z, u) satisfies the inequality 
l|, H(z) + v)]] < [Ar (x) + Aa(z)e(z) - Aa(z)y7"(x)Kz|| + llo 1I ol 


Thus, to satisfy (14.35), we need the inequalities 


‘ 


|Aa(z)I| € «o < 1 (14.36) 


and ; 
Aa (z) + Aa(x)a(z) - Az(z)y" (z)KT(z)| < p(z) ^ (14.37) 


to hold over a domain that contains the origin for some continuous function p(x). 
Inequality (14.36) is restrictive because it puts a definite limit on the perturbation 
A». Inequality (14.37), on the other hand, is not restrictive, because we do not 
require p tobe small. It is basically a choice of a function p to estimate the growth 
of the left-hand side of (14.37). A 


Consider now the system (14.30) and apply the control u = w(t,z) +v. The 
closed-loop system 


å = f(t2) + G(t, z)U(t 1) + G(tz)[v + 6(t, 2, p(t, £) + v)] (14.38) 


M can be easily seen that the perturbed system is still feedback linearizable with the same 
diffeomorphism T(z), provided J + A2 is nonsingular. Condition (14.36) implies that J + Ag is 
nonsingular. 


z 
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is a perturbation of the nominal closed-loop system (14.32). Let us calculate the 
derivative of V (t, x) along the trajectories of (14.38). For convenience, we will not 
write the argument of the various functions. We have 

JAR oV | V 


V= = J t Gg * C + gC tÀ) S —aa((|x|) + 


n and rewrite the last inequality as 


er ova 6) 
Set wT = 
V € —os(|zi) + w^v + w^6 


The first term on the right-hand side is due to the nominal closed-loop system. The 
second and third terms represent, respectively, the effect of the control v and the 
uncertain term ô on V. Due to the matching condition, the uncertain term ó appears 
on the right-hand side exactly at the same point where v appears. Consequently, 
it is possible to choose v to cancel the (destabilizing) effect of ô on V. We will 
now explore two different methods for choosing v so that w7v + wô < 0. Suppose 
inequality (14.35) is satisfied with ||- ||; that is, 


lelt, x, (t,x) + v)lla < e(t z) + &ollvla, Qo «1 
We have 

wv + w^ó € wTv + |wlla lllo < wv + |fwllalo(t, £) + olill] 
"Taking 


SEO): (14.39) 


lwll 
with a nonnegative function 7, we obtain 
wv 4 wd < —n|w|l + el|wlla + &onllwll = —n(1 — so) llla + ellvllz 
Choosing 7(t, £) > p(t,x)/(1 — xo) for all (t, £) € [0, 00) x D yields 
w7vy 4- wd € -pllull2 + pl|wlla = 0 


Hence, with the control (14.39), the derivative of V(t, x) along the trajectories of 
the closed-loop system (14.38) is negative definite. 
As an alternative idea, suppose (14.35) is satisfied with || - ||.o; that is, 


. lló(t, x, P(t, x) + v)llos < p(t,z) + Kollelloo 
We have 


O< Ko <1 


wy + ws < uly + lula Illo < wTv + [lh jolt, x) + solvilo] 


Choose 


ve —7(t. r) sen(w) (14.40) 
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where 7(t,2) > p(t,z)/(1 ~ xo) for all (t,2) € (0,00) x D and sen(w) is a p- 
dimensional vector whose ith component is sgn(w;). Then, 


wuu € -mn|wl + plell + sonlill: 
= —n(1 ~ s)lhelh + ell: 
S -plhel + lwli = 0 


Hence, with the control (14.40), the derivative of Vit, a) along the trajectories of 
the closed-loop system (14.38) is negative definite. Notice that the control laws 
given by (14.39) and (14.40) coincide for single-input systems (p = 1). 

The control laws given by (14.39) and (14.40) are discontinuous functions of the 
state z. This discontinuity causes some theoretical as well as practical problems. 
Theoretically, we have to change the definition of tle control law to avoid division 
by zero. We also have to examine the question of existence and uniqueness of so- 
lutions more carefully, since the feedback functions are not locally Lipschitz in z. 
Practically, the implementation of such discontinuous controllers is characterized by 
the phenomenon of chattering, where, due to imperfections in switching devices or 
computational delays, the control: has fast switching fluctuations across the switch- 
ing surface.!? Instead of trying to work out all these problems, we will choose the 
easy and more practical route of approximating the discontinuous control law by 
a continuous one. The development of such approximation is similar for both con- 
trol laws. Therefore, we continue with the control (14.39) and leave the parallel 
development of a continuous approximation of (14.40) to Exercises 14.21 and 14.22: 

Consider the feedback control law 


-n(tz)w/lwla), —ifn(5z)lwla 2 € 
cvaddtco ap | -1?(t,2)(w/e), | 
With (14.41), the derivative of V along the trajectories of the closed-loop system 


(14.38) will be negative definite whenever 7(t, z)||w|l2 > e. We only need to check 
V when 7(t,r)||wll2 < £. In this case, 


if n(t,x)||wll2 < € 


y w 
V < -aa(llalla) +u" |? = +4] 
E T 2 
S '-es(llzlla) = — lwl + plell + sollwllallvlle 
l Kon? 
= -ex(lirlo) - Tlel + ølwle + “lwl 


2 
< -os(lala) + (1 ~ ro) (- Tul + aet) 


155ee Section 14.1 for further discussion of chattering, 


AR mL 
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The term 3 
- Tul + nwl 


attains a maximum value £/4 at nl|w|la = &/2. Therefore, 


V os] E 


whenever n(t,x)||w|l2 < €. On the other hand, when n(t, z)||wll2 2 e, V satisfies 


V < -ostlla) € exti) + E 


Thus, the inequality i j 
$ e(l — Ko 
V < -os(llo) + S9 
is satisfied irrespective of the value of n(t, z)||wll. Take r > 0 such that B. cD, 
choose € < 203(a 3 *(a1(r)))/(1 — Ko), and set u = a3 '(e(1 — Ko) /2) < az (ax(r)). 
Then, 
Y €-los(|zlo. Vus elle <r 


Application of Theorem 4.18 results in the following theorem, which shows that the 
solutions of the closed-loop system are uniformly ultimately bounded by a class K 
function of €. 


Theorem 14.3 Consider the system (14.30). Let D C R^ bea domain that con- 
tains the origin and B, = (||zlla € r} C D. Let w(t,z) be a stabilizing feedback 
control law for the nominal system (14.31) with a Lyapunov function Vit, z) that 
satisfies (14.33) and (14.34) in 2-norm for all t > 0 and all z € D, with some 
class K functions a1, @2, and aa. Suppose the uncertain term ó satisfies (14.35) 
in 2-norm for all t > 0 and all x € D. Let v be given by (14.41) and choose 
e < 2o3(o5 ! (oa(r)))/(1 — Ko). Then, for any lz(o)lla < az *(ar(r)), there exists 
a finite time tı such that the solution of the closed-loop system (14.38) satisfies 


lz(£)lla € B(\[x(to)ll2,t- to), Vtost<t (14.42) 
lz < ble) Viz (14.43) 
where B is a class KL function and b is a class K function defined by 
ble) = o3 (azlu)) = ox (os (o! (El — 50)/2))) 


If all the assumptions hold globally and c belongs to class Koo, then (14.42) and 
(14.43) hold for any initial state z(!o). o 


in ` & Sake Sec TaN 
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Thus, in general, the continuous Lyapunov redesign given by (14.41) does not stabi- 
lize the origin as its discontinuous counterpart (14.39) does. Nevertheless, it guar- 
antees uniform ultimate boundedness of the solutions. Since the ultimate bound 
b(e) is a class X function of e, it can be made arbitrarily small by choosing ¢ small 
enough. In the limit, as e — 0, we recover the performance of the discontinuous con- 
troller. Notice that there is no analytical reason to require € to be very small. The 
only analytical restriction on € is the requirement £ < 2a3(a9 1(ay(r)))/(1 — Ko). 
This requirement is satisfied for any € when the assumptions hold globally and a; 


` (i= 1,2,3) are class Xo functions. Of course, from a practical viewpoint, we would 


like to make & as small as feasible, because we would like to drive the state of the 
system to a neighborhood of the origin that is as small as it could be. Exploiting the 
smallness of ¢ in the analysis, we can arrive at a sharper result when the uncertainty 
6 vanishes at the origin. Suppose there is a ball B, = (||z|g € a}, a € r, such that 
the following inequalities are satisfied for all x € Ba: 


as(llzlo) = e*(z) (14.44) 
"(z) > «0 (14.45) 
p(tz) < pols) (14.46) 


Here, ¢ : R” — R is a positive definite function of x. Choosing ¢ < b~! (a) ensures 
that the trajectories of the closed-loop systems will be confined to B, after a finite 
time. When n(t, z)||w||2 <€, the derivative V satisfies 


. 2 - 
y < allele) - TO") jul + ol 
2(1— 
< -laelo- 18) - BAX) u+ agal 
T _1f o) | [1 =M $(z) 
s -gollel -| foe | Lm ori ove | Let | 


The matrix of the quadratic form will be positive definite if € < 2n§(1 — &o)/pi. 
Thus, choosing € < 2n2(1 — &o)/p, we have V- € —os(||r|l/2. Since V < 
—a3(||z|l2) € —as(lzl2)/2 when n(t, z)]|wlla > e, we conclude that 


Aso 1 
; Y S - gallel) . 


which shows that the origin is uniformly asymptotically stable. 


Corollary 14.1 Assume the inequalities (14.44) through (14.46) are satisfied, in 
addition to all the assumptions of Theorem 14.3. Then, for alle < min{2n2(1 — 
&o)/p?, b^l(a)), the origin of the closed-loop system (14.38) is uniformly asymp- 
totically stable. If a;(r) = kjr?, then the origin is exponentially stable. © 


Corollary 14.1 is particularly useful when the origin of the nominal closed-loop 
system (14.32) is exponentially stable and the perturbation ó(t, x, u) is Lipschitz in 
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z and u and vanishes at (x = 0, u = 0). In this case, ¢(z) is proportional to |[z|| 
and the uncertain term satisfies (14.35) with p(x) that satisfies (14.46). In general, 
the condition (14.46) may require. more than just a vanishing perturbation at the 
origin. For example if, in a scalar case, ¢(z) = |z|*, then a perturbation term x 
cannot be bounded by p1¢(z). 

The stabilization result of Corollary 14.1 is dependent on the choice of 7 to 


satisfy (14.45). It can be shown (Exercise 14.20) that if 7 does not satisfy (14.45), ` 


the feedback control may fail to stabilize the origin. When 7 satisfies (14.45), the 
feedback control law (14.41) acts in the region 7||w||2 < € as a high-gain feedback 
control v = —kw with k > nZ/e. Such high-gain feedback control law can stabilize 
the origin when (14.44) through (14.46) are satisfied (Exercise 14.24). 


‘Example 14.4 Let us continue Example 14.3 on feedback linearizable systeins. 
Suppose inequality (14.36) is satisfied in || - ||. Suppose further that 


[|A1(z)  Az(z)a(z) + Az(z) ^ (2) Kalla < prillzlle 


for all z € B, C D,. Then, (14.37) is satisfied with p = pi||z||. We take the control 
v as in (14.41) with i 


oe T plell = mooto gen (ml 2r? dmin(P) ) 
n=l | EY -w° = 22° PB, e< min A Se —, T kona (P) 


It cau be verified that all the assumptions of Theorem 14.3 and Corollary 14.1 are 
satisfied with a(r) = Amin(P)r?, aa(r) = Amax(P)r?, as(r) = r?°, (2) = |lzlla, 
and a = r. Thus, with the overall feedback control u = (zx) + v, the origin of 
the perturbed closed-loop system is exponentially stable. If all the assumptions 
hold globally and T(z) is a global diffeomorphism, the origin z = 0 will be globally 
asymptotically stable.19 e ^ 


Example 14.5 Reconsider the pendulum equation of Example 13.18, with ô; = r. 


ij = 2 


[i 


do asin zı — bz + cu 

We want to stabilize the pendulum at the open-loop equilibrium point z = 0. This 
system is feedback linearizable with T(z) = z. A nominal stabilizing feedback 
control can be taken as 


v(z) =- Bg sinz, — (=) (kızı + hea) 


16The origin z = 0 will be globally exponentially stable, but we cannot conclude that z = 0 
will be globally exponentially stable, unless the linear growth conditions ||T(z)| € ZL1illzl| and 
WT WE < Lallzl| hold globally. 
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where à and ĉ are the nominal values of a and c, respectively, and kı and kz are 


chosen such that 
52 0 1 
A BK =| s Pae 


is Hurwitz. With u = (x) + v, the uncertainty term 6 is given by 
1|/aĉ-âc\ , E c-é 
ó- E ( i sinas — (2:3) (zi us) 4 ( z E 


ló] € eslizila + «olv, VreR? vveR 


c—é 


VE +k? 


Assuming Ko < 1 and taking v as in the previous example, we find that the control 
law u = (xz) +v makes the origin globally exponentially stable. In Example 13.18, 
we analyzed the same system under the control u = (x). Comparing the results 
shows exactly the contribution of the additional control component v. In Exam- 
ple 13.18, we were able to show that the control u = (x) stabilizes the system 
when k is restricted to satisfy : : 


1 
2 / pio + Pe 


This restriction has now been completely removed, provided we know k. A 


k« 


Example 14.6 Once again, consider the pendulum equation of the previous ex- 
ample. This time, suppose the suspension point of the pendulum is subjected to 
a time-varying, bounded, horizontal acceleration. For simplicity, neglect friction 
(b =0). The state equation is given by — 


$i = 22 
i9 = asinz;-cu-h(t)cosz; 


where A(t) is the (normalized) horizontal acceleration of the suspension point. We 
have |h(£)| € H for all t > 0. The nominal model and the nominal stabilizing 
control can be taken as in the previous example (with b = 0). The uncertain term 
6 satisfies 

15] € p1 lizila + Ko lv] + H/6 


where pı and «o are the same as in that example. This time, we have p(x) = 
pillz|l2 + H/é, which does not vanish at z = 0. The choice of 7 in the control law 
(14.41) must satisfy n > (:llzllo + H/é)/(1—Ko). We take n(x) = no + pillzll/(1 — 
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Ko) with mo > H/&(1 — ko). In the previous example, we arbitrarily set (0) = 1. - 
This is the only modification we have to make to accommodate the nonvanishing 
disturbance term h(t) cosa . Since p(0) # 0, Corollary 14.1 does not apply. We can 
only conclude, by Theorem 14.3, that the solutions of the closed-loop system are 
uniformly ultimately bounded and the ultimate bound is proportional to ve. A 


14.2.2 Nonlinear Damping — €^5e PART ICIAR 
Reconsider the system (14.30) with ó(t,z,u) = T(t,x)do(t, z, u); that is, 
i = f(t, £) + G(t, z)[u + T (t, z)do(t, z, u)l (14.47) 


As before. we assume that f and G are known, while do(t,z,u) is an uncertain 
term. The function T(t, £) is known. We assume that f, G, T, and do are piecewise 
continuous in ¢ and locally Lipschitz in z and u for all (£,z,u) € [0, 00) x R^ x RP. 
We assume also that ĝo is uniformly bounded for all (t, zu). Let V(t,z) be a nom- 
inal stabilizing feedback control law such that the origin of the nominal closed-loop 
system (14.32) is globally uniformly asymptotically stable and there is a known Lya- 
punov function V (t, z) that satisfies (14.33) and (14.34) for all (t, z) € [0, o0) x £^ 
with class K» functions o1, @2, and ag. If an upper bound on ||óo(t, z, u)|| is known, 
we can design the control component v, as before, to ensure robust global stabi- 
lization. In this section, we show that even when no upper bound on ĝo is known, 
we can design the control component v to ensure boundedness of the trajectories 
of the closed-loop system. Toward that end, let u = V(t, z) + v and recall that the 
derivative of V along the trajectories of the closed-loop system satisfies 


y e E a Kia awa SG + Tha) < coste] + wto +T) 
where wT = [0V /ðz]G. Taking 
v= -kulia k»0 —— (14.48) 
we obtain l 


V < —os(lizli) — klhwlielI là + lwllelT Ileko 
in which ko is an (unknown) upper bound on ||óo||. The term 
-k|rwlleliT IS + livelli T lizko 


attains a maximum value k2/4k at ||w|l2|| llla = ko/2k. Therefore, 
ee kg 
V € -ox(lizll) zz wf 


Since a is class Koo, it is always true that V is negative outside some ball. 1t follows 
from Theorem 4.18 that for any initial state z(to), the solution of the closed-loop 
system is uniformly bounded. The Lyapunov redesign (14.48) is called nonlinear 
damping. We summarize our conclusion in the next lemma. 


` Bo£€4 c 
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Lemma 14.1 Consider the system (14.47) and let (t) be a stabilizing feedback 
control for the nominal system (14.31) with a Lyapunov function V (t,x) that sat- 
isfies (14.33) and (14.34) for all t > 0 and all x € R", with some class Ky, func- 
tions a1, a2, and a3. Suppose the uncertain term ĉo is uniformly bounded for 
(t x,u) € [0, oo) x R^ x RP. Let v be given by (14.48) and take u = p(t, x)--v. Then 
for any z(to) € R^, the solution of the closed-loop system is uniformly bounded. o 


Example 14.7 Consider the scalar system 


i =z? +u + xdo(t) 


whera 5o(t) is a bounded function of t. With the nominal stabilizing control (x) = 
-It — T, the Lyapunov function V(x) = z? satisfies (14.33) and (14.34) globally 
with o5 (r) = a2(r) = a3(r) = r°. The nonlinear damping component (14.48), with 
k = 1, is given by v = —2r°. The closed-loop system 


= —z — 22° + 2dq(t) 


has a bounded solution no matter how large the bounded disturbance do is, thanks 
to the nonlinear damping term —2z?. l ' A 


14.3  Backstepping 


We start with the special case of integrator backstepping. Consider the system 


ġ fin) + 9(n)é (14.49) 
E= u (14.50) 


where [77 €]7 € R"*! is the state and u € R is the control input. The functions 
f : D — R” and g : D — R" are smooth!” in a domain D C R” that contains 
n «0 and f(0) 2 0. We want to design a state feedback control law to stabilize the 
origin (n = 0, € = 0). We assume that both f and g are known. This system can 
be viewed as a cascade connection of two components, as shown in Figure 14.15(a); 
the first component is (14.49), with & as input, and the second component is the 
integrator (14.50). Suppose the component (14.49) can be stabilized by & smooth 
state feedback control law € = $(n), with $(0) = 0; that is, the origin of 


= f(n) + 9(n) An) 


is asymptotically stable. Suppose further that we know a (smooth, positive defini 
efinite 
Lyapunov function V(7) that satisfies the inequality sa 


ð 
Z tamom s -Wi).  YneD (14.51) 


ia aera RRRUET A 
We require smoothness of all functions for convenience. It will become clear, however, that in 
a particular problem, we only need existence of derivatives up to a certain order. 
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where W (1) is positive definite. By adding and subtracting g(7)¢(7) on the right- 
hand side of (14.49), we obtain the equivalent representation 


À = [A +9(n)o(n)] + s((€ - O(n) 
€ = u 


which is shown in Figure 14.15(b). The change of variables 
z=€~$(n) ` 


results in the system 


9 = [f(n) + gel) + gin) 
ż = u-ó 


which is shown in Figure 14.15(c). Going from Figure 14.15(b) to Figure 14.15(c) 
can be viewed as “backstepping” —@(7) through the integrator. Since f, g, and ¢ 
are known, the derivative ¢ can be computed by using the expression 


js Sou) + (ol 


Taking v = u — ġ reduces the system to the cascade connection 


7 [f (1) + 9(n)d(n)] + g(n)z 
z= v.’ 


which is similar to the system we started from, except that now the first component 
has an asymptotically stable origin when the input is zero. This feature will be 
exploited in the design of v to stabilize the overall system. Using 


Vems) = V(m + 327 


as a Lyapunov function candidate. we obtain 


Ve = Rif) monit Falme + zo 


av 
~W(n) + ——e(mz + zv 


1A 


(14.50); (b) introducing $(7): 


The block diagram of system (14.49) 
(n) through the integrator. 


Figure 14.15: (a) 


Choosing (c) "backstepping! —9 
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which shows that the origin (1 = 0, = = 0) is asyinptotically stable. Since ¢(0) = 0, 
we conclude that the origin (7 = 0, € = 0) is asymptotically stable. Substituting 
for v, z, and $, we obtain the state feedback control law 


u- Set) + g(n)€] - S oln) - ME - 4(n)] (14.52) 


If all the assumptions hold globally and V(n) is radially unbounded, we can conclude 


that the origin is globally asymptotically stable. We summarize our conclusions in 


the next lemma. 


Lemma 14.2 Consider the system (14.49)-(14.50). Let (n) be a stabilizing state 
feedback control law for (14.49) with ¢(0) = 0, and V (n) be a Lyapunov function that 
satisfies (14.51) with some positive definite function W(n). Then, the state feedback 
control law (14.52) stabilizes the origin of (14.49)-(14.50), with V (n) + [E — ¢(n)|?/2 
as a Lyapunov function. Moreover, if all the assumptions hold globally and V(n) is 
radially unbounded, the origin will be globally asymptotically stable. > 


Example 14.8 Consider the system 
i = x? - zi T $9 
$9 = u 
which takes the form (14.49)-(14.50) with n = zı and € = z2. We start with the 


scalar system 
t=22-23 +29 


with z2 viewed as the input and proceed to design the feedback control ro = ¢(11) 
to stabilize the origin 1; = 0. With 


T? = $(zi) = —z2 — 2 
we cancel the nonlinear term z? to obtain!? 
ij2-r,- x 
and V(z,) = 2/2 satisfies 


y = =T} -1f < =°, Vr ER 


' Hence, the origin of tı = —z — q? is globally exponentially stable. To backstep, 


we use the change of variables . 
z2 = T} — (rj) = 3 zi x] 


!5Wo do not. cancel ~z}? because it. provides nonlinear damping. (See Example13.19.) 


14.8. BACKSTEPPING 593 


to transform the system into tlie form 


di = -zi-zldz, 
ut (19271) 721 — 2} + 22) 


dq 
Taking 
Vela) = 52} + 323 
as a composite Lyapunov function, we obtain 


Ve = z(n — 23 + 29) + àp[u + (14 2z1)(-231 - 23 + 29)] 
=z] = xf nni (1+ 223)(-2, - ai + 22) +4) 


Taking 
u = =z] — (1+ 221)(—ay — 23 + 22) -z; 
yields 
V= -ri -aia 
Hence, the origin is globally asymptotically stable. - A 


Application of integrator backstepping in the preceding example is straightfor- 
ward due to the simplicity of scalar designs. For higher order systems, we may retain 


this simplicity via recursive application of integrator backstepping, as illustrated by. 


the next example. 


Example 14.9 The third-order system 


ij = 2- r? tr 
i = T3 
$3 = u 


is composed of the second-order system of the previous example with an additional 
integrator at the input side. We proceed to apply integrator backstepping as in the 
previous example. After one step of backstepping, we know that the second-order 
system 

di = r -etr 

i2 = 23 


with x3 as input, can be globally stabilized by the control 


T3 = —2, — (1 + 2x1) (z1 — 2} +22) — (zo +24 +2?) def $(z1, z2) 


and 
V(zi,z2) = 3a]  3(12 21 + zi? 
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is the corresponding Lvapun i 
variables 8 “yapunov function. To backstep, we apply the change of 


23 = v3 — (11,22) 


to obtain 
i = rer? tr 
£2 v (T1, za) + 23 
: g à 
23 = 4-——(72_ 73 o $ P 
Dr, (zi — 23 + z2) aes? +23) 


Using V, = V + 22/2 as a composite Lyapunov function, we obtain 
: av 
V. zn 2 ER ôV 
c ori (zi - zi +22) + z; (23 +) 


: 06 06 
+ 23 fe = Ba, (ti ~ rp +2) — 87; (73 + 4] 


S and 
= =r] ~a] — (22 +T, +22)? 


OV ` 00, , 3 a¢ 
+ zy [= - B; —£zi42)— Fag (+8) +u 
Taking 
xz SEV ôb,» 3 o¢ 
u Onn Oz, 7 ~ TL 42) Fg (z5 +d) ~ 2g 
yields 
Ve = ~z? — xf — (2942, taly — 22 

Hence, the origin is globally asymptotically stable. à A 


Let us move now from (14.49)-(14.50) to the more general system 


à = fin) +g) (14.53) 
€ = fne on £u (14.54) 


where fa and ga are smoot MES 
tronsforrnátio i a ooth. If g,(n,£) # 0 over the domain of interest, the input 


1 
Lx Pond ~ faln,€)] (14.55) 


Mores (14.54) to the integrator € = ug. Therefore, ifa stabilizing state feedback 
control law (7) and a Lyapunov function V(n) exist such that the conditions of 


Lemma 14.2 are satisfied for (14.53), then the lemma and (14.55) yield 


u = én €) 
i 
ga( €) 


H 


9o oV 
{ ay! (n) + g(n)é] - groo -kE - ġ())}- hg} (14.56) 
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for some k > 0 and 
V.(n,£) = V(m + 1€ - o)l? (14.57) 


as a stabilizing state feedback control law and a Lyapunov function, respectively, 
for the overall system (14.53)-(14.54). By recursive application of backstepping, we 
can stabilize strict-feedback systems of the form 


.$ = fo(z) t+ go(r)a 
4 = fiz, 21) + g(x z): t 
ż2 = fo(z, 21,22) + ga 21; 22)23 

iki = fkei(m Zis... Ze)  gk-i(2, Za, + Zh) Zk 
k = fe (Ty 21.06. Zk) Gn Z1,- Aku 


where z € R”, z; to z, are scalars, and fo to f, vanish at the origin. The reason 
for referring to such systems as "strict feedback" is that the nonlinearities f; and gi 
in the Z;-equation (i = 1,..., k) depend only on z,2;,...,2;; that is, on the state 
variables that are "fed back." We assume that : 


l altz.) #0 forl Sisk 
over the domain of interest. The recursive procedure starts with the system 
i = folt) + go(z)z 


where z; is viewed as the control input. We assume that it is possible to determine 
a stabilizing state feedback control law z; = do(z), with do(0) = 0, and a Lyapunov 
function Vo(x) such that 


Pra (2) + go(z)én(e)] < -W(z) 


over the domain of interest for some positive definite function W(x). In many appli- 
cations of backstepping, the variable x is scalar, which simplifies this stabilization 
problem. With óo(r) and Vo(r) in hand, we proceed to apply backstepping in a 
Systematic way. First, we consider the system 


t = fola) + go(z)z 
false, 21) + nle 2)z 


i 


4 
as a special case of (14.53)-(14.54) with 
=T, Sin, US. T= fo, g = 90; faf. 978, 


í(—— A 
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We use (14.56) and (14.57) to obtain the stabilizing state feedback control law and 
the Lyapunov function as 


1 [2 OW, 
1(z, 21) = A ET +9021) — A^ -kh(n-$)-h|, h»0 


Vi(z, 21) = Vo(z) + la - o(2)]? 
Next, we consider the system 


Be 
l 


fo(z) + go(z)z 
4A = fi(z,21)+91(z, 21)22 
Falz, 21, 22) + go(z, z1, 22)z3 


N- 
[o 
li 


as a special case of (14.53)-(14.54) with 


"=| b | € = z9, U = 23, fae es Ji 


z f MEL fa = £2 


Using (14.56) and (14.57), we obtain the stabilizing state feedback control law and .. 
the Lyapunov function as 
_ 1 [84 Og, OV; 
p(T, 21,22) = m EC t goz) + 54 V + 9122) - $49 = ko(za - $1) - f 
for some ks > '0 and l 
Vo(z, 21, 22) = Vi (x, z1) + 3[z2 — ġ2(z, zi)? 


This process is repeated & times to obtain the overall stabilizing state feedback . 
control law u = ,(2, 21,..., zx) and the Lyapunov function Vc(2, Zis... Zk) 


Example 14.10 Consider a single-input-single output system in the special nor- ' 
mal form 


i = fo(z)-go(z)a 


21 = 2 

io) coi 
ap = ¥(z,z)[u — a(x, z)] 
y = 2 


where x € R^77, z to z, are scalars, and y(x, z) Æ 0 for all (2,2). This represen- 
tation is a special case of the normal form (13.16)-( 13.18) because the ¢-equation 
takes the form fo(z) + go(z)z;, instead of the more general form fo(z,z). The 
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Thus, 


^n à 47 E 5 s.s t m 
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system is in the strict feedback form. The origin cau be globally stabilized by ro- 
cursive backstepping if we can find a smooth function ¢9(x) and a smooth radially 
unbounded Lyapunov function Vo(x) such that 


P fts) + oo(z)¢o(e)] <-Wee), Yz eR" 


for some positive definite function W (x). If the system is minimum phase, the origin 
of = fo(x) is globally asymptotically stable, and we know a Lyapunov function 
Vo(x) that satisfies i 

9Vs 

Ox 
for some positive definite function W(x), we can simply take ¢o(x) = 0. Otherwise, 
we have to search for ¢o(z) and Vo(z). This shows that backstepping allows us 
to stabilize nonminimum phase systems, provided the stabilization problem for the 
zero dynamics is solvable. A 


fo(e) -W(z) VzeH 


Example 14.11 The second-order system 
j = -+n £ 
Eai 
was considéred in Example 13.16, where it was shown that u = —ké, with sufficiently 


large k > 0, can achieve semiglobal stabilization. In this example, we achieve global 
stabilization via backstepping. Starting with the system 


q=—ntne 
it is clear that € = 0 and Vo(7) = 77/2 result in 
Vo E en 
MA -J)e-py, Y 
Sr ee HER 


Using V = Vo + 7/2 = (n? + €7)/2, we obtain 
V =n- +n E) + £u = = + €(9 +u) 


uz-p-k& k>0 
globally stabilizes the origin. A 
Example 14.12 As a variation from the previous example, consider the system? 
à = n-ne 
E= uc 


I9With the output y = £, the system is nonminimum phase, because the origin of the zero- 
dynamics equation rj = y? is unstable. 
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X pl 1 l on: di I y 
E ample 4 4 C Side. again the System 
for SO A > 0 enden! Oi E. In th Inters 


{n(z)|z2| < £}, we have 


EEES. 


Ti = £2462, sinz 


"NK 2 
T2 = r+ +u 1623 * 
€ 


Ve < 23 -kz + nidnillal + piis! - 
fr i i | | i 

rid n previous example, where |£1| € a and : 
a analysis to a compact set in order to satisfy i d | - J i Mn S . : É 
onsequently, we could Only achieve semig] 


The bracketed term can be made nonnegative by.choosing € small enough. Hence, 


Ves -x? + zazi + yy (z) + V2(z,0) + ul 


In Example 14.13, we used u 
18, we --—2- 
dea] with the uncertainty, This S nie 


i ed the nonli 2 ¢ 
the linear term p|ra|. Here, we ae nlinear term zê to be bounded by 


u = rn — p(t) — kz +v, k>0 
where the control component v is to be designed. Then 
| Ve S ~a] ~ kz} + zo (n. 0) + v] 
Noting that 
ly2(z, 8) < a(1-t a)|z;| + bx? 
we take 
ote | -"(z)sgn(z), if n(z)|z9| > € 
~n?(z)22/s, 
where n(x) = no -a(14- a)|z1| + bz 


if n(z)|z2] < € 
for some no > 0 and € > 0. When n (x)|z2] > e, 
2[to(z, 0) + v] < Wilfza] - nza] < 0 


z) — kzz and relied on the high gain k to 


2: 


| 
| 
| 


Vise —iz} — kz 
and the origin is globally asymptotically stable. A 


We conclude the section by noting that backstepping can be applied to multiin- 
put systems in what is known as block backstepping, provided certain nonsingularity 
conditions are satisfied. Consider the systein 

ù Fin) + G(6 (14.68) 
3 falm £) + Ga(n &)u (14.69) 


where 7 € R”, € € R™, and u € R™, in which m could be greater than one. Suppose 


i 


f, fa, G, and Ga are (known) smooth functions over the domain of interest, f and 


fa vanish at the origin, and the m x m matrix Ga is nonsingular. Suppose further 
that the component (14.68) can be stabilized by a smooth state feedback control 
law € = $(n) with ¢(0) = 0, and we know a (smooth, positive definite) Lyapunov 
function V(7) that satisfies the inequality 


aru) + Gimol] < —W(n) 


for some positive definite function W(r). Using 
Ve = V(n) + àl£ - m) [€ - 9()] 


as a Lyapunov function candidate for the overall system, we obtain 


OO CCC FEE CE CCF CFRECOERE 


and when n(2)|z9| < e av av ð$ hd 
i : Ve= (fF +69) 4+ ZG (E- 9) 4 E- il $e E +G6) 
22[¥2(z,0) - v] < Inilza| — 22 < i Taking , bs 
€ 
Thus, 8ó av NT [^ 
w= Gz" | +66) - (FG) -n-ke- |. >o E. 
E s-d-kibei à E an d uc" o 
This inequality shows that withi Bite aac ve results in Ll 
of radius ra ko fo in na finite tine interval, the state z enters a hall B, av ^w 
RM MM E A Ve = BoA + GO) - KE - ola e — $0] < - Wn) = KE = ODITE = 0 Ne 
Va(r.0)| < +L: i 
Mar D Sal + ari] +b Ital S Pi] Lol) which shows that the origin (7 = 0, € = 0) is asymptotically stable. w 
i 
had 
l w 


+h 


| 


DNE F mm (dengue d dae oaeee ees - 
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zT 14.4 Passivity-Based Control "Therefore, by the invariance principle, the origin is globally asymptotically stable. : 


ü 

The intuition behind the theorem becomes clear when we think of the storage H 
function as the energy of the system. A passive system has a stable origin. All E 
that is needed to stabilize the origin is the injection of damping so that energy will 
dissipate whenever z(t) is not identically zero. The required damping is injected by 


B In Chapter 6, we introduced the notion of passivity and studied its role in ana- 
t lyzing the stability of feedback connections. The ideas of passivity-based control 
that we are going to introduce here are straightforward applications of the results 
E of Chapter 6. However, we do not need the elaborate details of Chapter 6 to under- 


BS stand these ideas. It is enough to recall the definitions of passivity and zero-state . the function ¢. There is great freedom in the choice of ¢. We can choose it to meet 
L. observability. any constraint on the magnitude of u. For example, if u is constrained to |u;| € ki : 
k . We consider the p-input-p-output system for 1 € i € p, we can choose ¢;(y) = ki sat(y;) or 4;(y) = (2k;/m) tan-! (yi). i 
X $ e. (14.70) The utility of Theorem 14.4 can be increased by transforming nonpassive systems : 
L ¢ = f(z,u) AM into passive ones. Consider, for example, a special case of (14.70), where ; 
1 : y = h(z) (14.71): ; 
f om & = f(x) +G(x)u 14.73) > : 
L where f is locally Lipschitz in (x,u) and h is continuous in z, for all z € R" JG (z) ( ) 
i- and u € R™. We assume that f(0,0) = 0, so that the origin z = 0 is an open- Suppose a radially unbounded, positive definite, continuously differentiable function.. f. .'. ! 
) loop equilibriurn’ point, and h(0) = 0. We recall that the system (14.70)+(14:71) V (2) exists such that i : 
m is passive if there exists a continuously differentiable positive semidefinite function . av ? 1 
A V (z) (called the storage function) such that = f(t) <0, Wa * i : 
E ` Y av oat Take ci A : 
2 VEU Ty>V=— V e R^ x R" 14.72) RELACIONADO CO : 
y . The system is zero-state observable if no solution of ¢ = f (x, 0) can stay identically A : * AG or REALINENTACION CON WA , 
is in the set (h(z) = 0) other than the trivial solution z(t) = 0. Throughout, this .. -° Then the system with input u and output y is passive. If it is also zero-state 
J section we will require the storage function to be positive definite. The basic idea.. . 4 observable, we can apply Theorem 14.4. 
' of passivity-based control is illustrated in the next theorem. Lau TN 
A , Example 14.15 Consider the syst ov : 
» „Theorem, 14.4" Jf the system (14.70)-(14.71) is P nsider the system s d- ts tein 
" (1) passive with a radially unbounded positive definite storage function and ! i = X3 l 
5 : : fg = ~ru 
(2) zero-state observable, į 
Je orai SON NN " F Let V(z) = z1/4-- 23/2. Then 
"s ` A then the origin x = 0 can be globally stabilized byfu = —¢(y)| where ¢ is any locally 1 1 2/2. 
? h; H = 0 » "- = $ " . 
i ceri n bi ii jx ! b: ga E m MM dps $ didok V = z123 — tor? + Tou = Tou 
K, Proof: Use the storage füüctioi (2) "as a Lyapunov function candidate for the & se = 
A closed-loop system Set y = x and note that, with u = 0, y(t) = 0 implies that x(t) = 0. Thus, all the 
; Jj i-f(z-é(y) conditions of Theorem 14.4 are satisfied and a globally stabilizing state feedback ; 
j l =- = -1 i i 
K dis daivative al Vd eivenby control can be taken as u kag or u (2k/m) tan"! (x2) with any k > 0. A i 
a i 
V . OV T Allowing ourselves the freedom to choose the output function is useful, but we i 
R V = 5, fol) S -y (y) <0 are still limited to state equations for which the origin is open-loop stable. We can i 
E: ae ERN ED : | cover a wider class of systems if we use feedback to achieve passivity. Consider ; 
m Hence, V is negative semidefinite and V = 0 if and only if y = 0. By zero-state again the system (14.73). If a feedback control i 
y observability, " 
9. y(t) 80 2 u(t)=0 => z(t) «0 (14.74) 
2 die ¢ , e 
~. RELACION can LIN. Dede ym ENTACION 


2 
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————— o—! d 


and an output function A(z) exist such that the system 
—————ÓÓ—— 


i = f(x) +G(z)a(z) + G(z)B(z)v (14.75) 
y = A(z) (14.76) 


with input v and output y, satisfies the conditions of Theorem 14.4, we can globally 
stabilize the origin by using v = —¢(y). The use of feedback to convert a nonpassive 
system into a passive one is known as feedback passivation.”? 


; 


AA 


Jj 


Defining the output as y — &, we see that the system with input v and e i 
is passive with V as tlie storage function. It is interesting to note that the ro : 
the passifying feedback component g(g) — Ape is to reshape the potential energy 9 
(1/2)e7 Kpe. which has a unique minimum at e = 0. The sum of the kinetic energy 
and the reshaped potential energy is the storage function. With v — 0, 


^*^ 


n 
] 


y(t) =0 e e(t)=0 > &(t)=0 > K,e(t)=0 > e(t) =0 


which shows that the system is zero-state observable. Hence, it can be globally 
stabilized by the control v = —ó(é) with any function @ such that (0) =0 and 
yT (y) > 0 for all y # 0. The choice v = —K4é with a positive definite symmetric 
matrix Kg results in the control 


u= g(a) - Ky(a - e.) - Kad 


which takes the form of a classical PD controller plus a gravity compensation term 
ERE HE 7 z 


Example 14.16 The nonlinear dynamic equations for an m-link robot take the 
form 
M(q)ä + Cla, d)à + Då + glg) =u 

where q is an m-dimensional vector of generalized coordinates representing joint 
positions, u is an m-dimensional control input, and M(q) is a symmetric inertia 
matrix that is positive definite for all g € R™. The term C(q,q)q accounts for 
centrifugal and Coriolis forces. The inatrix C has the property that M —2C isa 
skew-symmetric matrix for all q,d € R™, where M is the total derivative of-M(q) 
with respect to t. The term Dd, where D is a positive semidefinite symmetric 
matrix, accounts for viscous damping. The term g(q), which accounts for gravity 
forces, is given by g(q) = [OP(q)/0q]', where P(q) is the total potential energy 


CE ARR RONAAAAAAAAAAAAAA 


One class of systems that is amenable to feedback passivation is the cascade 
connection of a passive system with a system whose unforced dynamics have a 
stable equilibrium point at the origin. Consider the system 


of the links due to gravity. Consider the regulation problem of designing a state TA : T (14.77) 
feedback control law so that q asymptotically tracks a constant reference q. Let govt GITAL , à = falz) + FG BR (14.78) 
e — q— qr. Then, e satisfies the differential equation E mor = 0$ = f(z) +G(z)u (14.79) 
M(q)é + Clg, d)é + Dé + glg) =u pe e "HT 
; ! ly - 
. Our goal is to stabilize the system at (e = 0,6 = 0), but this point is not an I where fa(0) 50, f(0) = 0, and h(0) = 0. The functions fa, P, f, and G isi locally 
ED hel : : x. iew th tem as a cascade connection of the 
; open-loop equilibrium point. Let f lN Lipschitz and|A is continuous} We view the syste ia its 
ecoute a4 Compensoute Len cols : driving system (14.78)- 14.79) and the driven system (14.77). We assume th \ 
a pipe uy ordi) here Yu the representation (14.77)-(14.79) is valid globally, the driving system is passive 


where K, is a positive definite symmetric matrix and v is an additional control 
component to be chosen. Substituting u into the é-equation yields 


M(g)é - C(q, d)é + Dé - Kpe=v 


i iti i ion V(z), the origin of 
i dially unbounded positive definite storage function 1 

res ne is sti e, and we know a radially unbounded Lyapunov function W(z) 
for à = f(z), which satisfies 


AL dl st. redvcido . 
Tus i METRE f 
V = Pe" M(g)é + łe Kye z 
2 2€ “p 2 
i te for the full system 

as a storage function candidate. The function V is positive definite and its derivative Using U(z,z) = W(z) + V(z) as a storage function candidate for - T 
satisfies . (14.77)- (14.19), we obtairi 4° nz 4 Lima < (2 x e ^ 

y ; Tyr; , . Ue Tz aV 

V = (M le] Mé 4 eT Kye , ais Ù = w M2) mud F(z,y)y + ov IG) + 5, v z 

-. leT(M - 2C)é - eT Dè — èT Kpe + 70 + eT Kye UE nur MD ead 


23A driven system of the form 2 = fo(z. y) with sufficiently smooth fo can be represented in the 
form (14.77) by teking 


< dy 


albe ed 
fa(z) = fo(z,0) and F(zy)- Sy Č sy) ds 
o 


with a positive definite Lyapunov function. : 


COC OOCOCL 


alis $e Ve ex da Me h(x) sa local nece Lipschitz ff 
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OW ., ior r aw E / 
< C F(yycty uy ut (5 Ely) 
oz dz 


The feedback control 


results in 


U<ytv 
Hence, the system 
à = fa(z)+F(z,y)y (14.80) 
z= seats) (D rta) «ay (1481) 
y = h(z) (14.82) 


with input v and output y is passive with U as the storage function. If the system 
(14.80)-(14.82) is zero-state observable, we can apply Theorem 14.4 to globally 


stabilize the origin. 


Example 14.17 The rotational motion of a rigid body subject to three indepen- 
dent scalar control torques can be modeled by?* 


p = tSo) +p" |w 
Mw = —S(w)Mw+u 


where w € R? is the velocity vector and p € R? is à particular choice of the kinematic 
parameters, which leads to a three-dimensional representation of the rotation group. 
The matrix S(z) is a skew-symmetric matrix, defined by 


0 —I3 Xo 
S(z) = T3 0 —X1 
—Z2 Tı 0 


M is a positive definite symmetric inertia matrix, and I; is the 3 x 3 identity 
matrix. Taking y — w, it can be seen that the system takes the form of the cascade 
connection (14.77)-(14.79) with 


Mo = —S(w)Mw+ u, y=w 
as the driving system and 
5 = ls + S(p) + pp ]o 


24See [97] and [151] for the derivation of the model. Ife € R3 and y € R are the Euler 
parameters, then p = €/n. 
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maa Aun comete d i Ro bow or 


as the driven system. Taking V(w) = (1/2)w? Mw, it can be seen that 


V =u" Mà = -w S(w)Mu 4 wTu = yTu 


where we used the property wT S(w) = 0. Hence, the driving system is passive. 
The unforced driven system f = 0 has a stable equilibrium point at p = 0 and any 
radially unbounded, positive definite, continuously differentiable function W (p) will 
qualify as a Lyapunov function. Thus, all our assumptions are satisfied and the " 
system can be made passive by the control 


aw T 
ume Us st) o1) tu 


Taking W(p) = kln(1 + p p), with k > 0, yields 


kp? T 1 
u=- { ells + SU) +00 i} +v=-kp+v 


where we used the property pT S(p) = 0. We need to check zero-state observability 


of the passive system 


ò = dh Slo) + pw 
Mw = -S(w)Mw—kp+v 
y= wW 
With v — 0, 
y(t) 80 & w(t) 80 2 w(t)=0 => p(t) 20 


Hence, the system is zero-state observable and can be globally stabilized by 
u = —kp — (w) 


with any locally Lipschitz function $ such that ¢(0) = 0 and y7¢(y) > 0 for all 
y #0. & 


$275 é p = . 
Checking zero-state observability of the full system (14.80)-(14.82) can be avoided 
if we strengthen the assumption on W (z) to 


ow 


OW faz) «0, Vz# 0, and -—5-(0)—0 (14.83) "4 


“Oz. 

which implies that the origin of z = f.(z) is globally asymptotically stable. Taking 
_ (aw z 

u=- (Fran) - 6 (14.84) 


a 


^. 
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where ¢ is. any locally Lipschitz function such that. $(0) = 0 and y7 ely) > 0 for all 
yz " and using U as a Lyapunov function candidate for the closed-loop system, 
we obtain i 


spp ge OW TA 4 
Us 5, fale) -a Hy) <0 
Moreover, U=0 implies that z = 0 and y = 0, which in turn imply that u = 0. If 
the driving system (14. 78)-(14.79) is zero-state observable, the conditions u(t) =0 


and y(t) = 0 imply that z(t) = 0. Hence, by the invariance principle, the origin 
(z = 0,z = 0) is globally asymptotically stable. We summarize this conclusion in 


the next theorem. 


Theorem 14.5 Suppose the system (14.78)-(14.79) is zero-state observable and 
passive with a radially unbounded, positive definite storage function. Suppose the 
origin of 2 = f(z) is globally asymptotically stable and let W(z) be a radially 
unbounded, positive definite Lyapunov function that satisfies (14.83). Then, the 


i _ control (14.84) globally stabilizes the origin (z = 0,2 = 0). o 


Example 14.18 Consider the system 


ù = -n+n £ 

É =u 
which was studied in Examples 13.16 and 14.11. With y = € as the output, the 
system takes the form (14.77)-(14.79). The system =u, y= € is passive with 
the storage function V(€) = £?/2. It is clearly zero-state observable, since y = £. 
The origin of 7j = —y is globally exponentially stable with the Lyapunov function 
W (n) = 77/2. Thus, all the conditions of Theorem 14.5 are satisfied and a globally 
stabilizing state feedback control can be taken as 


2-DP-k k»0 


which is the same control we derived by using backstepping A 


14.5 High-Gain Observers 


The nonlinear design techniques discussed in this chapter, and the previous one, 
assume state feedback; that is, measurements of all state variables are available. In 
many practical problems we cannot measure all state variables, or we may choose 
not to measure some of them due to technical or economic reasons. Therefore, it is 
important to extend these techniques to output feedback. In some special cases, we* 
can modify the technique to produce an output feedback controller. Examples are - 
explored in Exercises 14.47 and 14.48. The first exercise shows that for minimum- 
phase, relative-degree-one systems, we can design sliding mode control as output 
feedback. The second exercise shows passivity-based control for a system that has a 


14.5. HIGH-GAIN OBSERVERS 3 611 


passive map from the input to the derivative of the output. In more general cases, 
we have to use dynamic compensation to extend state feedback designs to output 
feedback. One form of dynamic compensation is to use observers that asyinptoti- 
cally estimate the state from output measurements. For some nonlincar systems, 
the design of such observers could be as easy as in linear systems. Suppose, for 
example, that a nonlinear system can be transformed into the form?’ 


i Az + g(y u) (14.85) 
y = Cr r (14.86) 


where (A, C) is observable. This form is special: because the nonlinear function g 
depends only on the output y and the control input u. Taking the observer as 


= Af g(y;u) + ty - C&) (14.87) 


_ it can be easily seen that the estimation error $ = z — satisfies the linear equation 


i-(A-HC)i 


Hence, designing C such that A — HC is Hurwitz guarantees asymptotic error 
convergence, that is, lim, ..5 Z(t) = 0. Exercise 14.49 explores the use of the ob- 
server (14.87) in output feedback control. Aside from the fact that the observer 
(14.87) works only for a special class of nonlinear systems, its main drawback is the 
assumption that the nonlinear function g is perfectly known. Any error in inodeling 
g will be reflected in the estimation error equation. In particular, if the observer is 
implemented as : 

f= Aê + go(y.u)-- H(y — Cá) 


where go is a nominal model of g, the -equation becomes 
È = (A- HC) + g(y. u) — goly, u) 


It is no longer obvious that a Hurwitz A — HC can handle the perturbation term 
9 — go. In this section, we give a special design of the observer gain that makes the 
observer robust to uncertainties in modeling tlie nonlinear functions. The technique, 
known as high-gain observers, works for a wide class of nonlinear systems and 
guarantees that the output feedback controller recovers the performance of the state 
feedback controller when the observer gain is sufficiently high. In Section 14.5.1, 
we use a second-order example to motivate the idea of high-gain observers. In 
Section 14.5.2, we use the observer in output feedback stabilization. The main result 
of that section is a separation principle that allows us to separate the design into 
two tasks. First, we design a state feedback controller that stabilizes the system and 


25Necessary and sufficient conditions for a nonlinear system to be equivalent to the form (14.85) 
(14.86) are given in (124. Chapter 5]. The same reference gives a different approach for introducing 
dynamic compensation through filtered transformations. 
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meets other design specifications. .Then, an output feedback controller is obtained 
by replacing the state x by its estimate $ provided by the high-gain observer. A 
key property that makes this separation possible is the design of the state feedback 
controller to be globally bounded in z. High-gain observers can be used in a wide 
range of control problems.29 As an example, we show in Section 14.5.3 the use of 
high-gain observers in output feedback integral regulators. 


14.5.1 Motivating Example 


Consider the second-order nonlinear system 


di E d (14.88) 
dj = ó(z,u) (14.89) 
y= 2 l (14.90) 


where x = [z1,23]7. Suppose u = *(z) is a locally Lipschitz state feedback control | 


law that stabilizes the origin z = 0 of the closed-loop system 
dj = 2 (14.91) 
i; = Ó(z,Y(z)) (14.92) 


To implement this feedback control using only measurements of the output y, we 
use the observer 


dy = ot hily— 41) (14.93) 
be = do(2,u) + haly- $1) (14.94) 


where do(z, u) is a nominal model of the nonlinear function ¢(z,u). The estimation 
error 


satisfies the equation 


zz) = —h,Z, + $9 (14.95) 
Ž2 —haá, + ó(z,Z) (14.96) 


where ó(z,£) = ó(z,y(£)) — ¢0(@,7(@)). We want to design the observer gain 
H = [hi, h2] such that limi—oo z(f) = 0. In the absence of the disturbance term 
6, asymptotic error convergence is achieved by designing H such that 


EY 
de ia] 


26See [100] for a survey of the use of high-gain observers in various control problem formulations. 
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is Hurwitz. For this second-order system, A is Hurwitz for any positive constants 
hı and ha. In the presence of ô, we need to design H with the additional goal of 
rejecting the effect of ô on Z. This is ideally achieved, for any 6, if the transfer 
function 


1 1 
Go(s) p s? -- his + ha | 8th | 
from 6 to ž is identically zero. While this is not possible, we can make super |Go(jw)| 
arbitrarily small by choosing h2 2» hı > 1. In particular, taking 
a 2. h = 2 (14.97) 


for some positive constants a1, o2, and e, with € < 1, it can be shown that 


s E € 
Gols) = (es)? + ayes + 02 | es +o | 


Hence, limzo Go(s) = 0. The disturbance rejection property of the high-gain 
observer can be also seen in the time domain by representing the error equa- 
tion (14.95)-(14.96) in the singularly perturbed form. Towards that end, define 
the scaled estimation errors 


E: x 
m= F m = G2 (14.98) 
The newly defined variables satisfy the singularly perturbed equation 


€ = -amm +M l (14.99) 
Eja —aa1A t &ó(z, z) (14.100) 


This equation shows clearly that reducing € diminishes the effect ô. It shows also 
that, for small e, the scaled-estimation error 7 will be much faster than x. Notice, 
however, that 71(0) will be O(1/e) whenever 21(0) # $1(0). Consequently, the 
solution of (14.99)-(14.100) will contain a term of the form (1/e)e~*/* for some 
a> 0. While this exponential mode decays rapidly, it exhibits an impulsive-like 
behavior where the transient peaks to O(1/e) values before it decays rapidly towards 
zero. In fact, the function (a/c)e-?*/* approaches an impulse function as € tends to 
zero. This behavior is known as the peaking phenomenon. It is important to realize 
that the peaking phenomenon is not a consequence of using the change of variables. 
(14.98) to represent the error dynamics in the singularly perturbed form. It is an ‘ 
intrinsic feature of any high-gain-observer with h; > hı > 1. This point can be 
seen by calculating the transition matrix exp(A,t) and noting that its (2,1) element 


is given by 
2 eht? gin ( 4ha =H) 


Yih — h? 2 


B VU M 
MVP 
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when 4h > h? and 


pit (AB) oam 


when 4; < hi. The amplitude of the exponential mode is greater than ha in the 
first case and h/h, in the second one. Thus, as we increase hy and h3/h;, we drive 
the amplitude toward infinity. 


To get a better feel for the peaking phenomenon, let us simulate the system 


$i = I9 
$9 = z3 +u 
y = n0 


which can be globally stabilized by the state feedback controller 
u = -T3 - T1 — T2 
The output feedback controller is taken as 
u = -$j-£i—d, 


$5 + (2/e)(y — 21) 
a/e?)(y - £1) 


where the observer gain assigns the eigenvalues of A, at —1/e and —1/e. Fig- 
ure 14.16 shows the performance of the closed-loop system under state and output 


&> 
I 


t. 


2 


feedback. Output feedback is simulated for three different values of e, The initial 


conditions are z;(0) = 0.1, z2(0) = 41(0) = £2(0) = 0. Peaking is induced by 
[z:(0) — 21 (0)]/e = 0.1/e when e is sufficiently small. Figure 14.16 shows a counter 
intuitive behavior as € decreases. Since decreasing € causes the estimation error 
to decay faster toward zero, one would expect the response under output feedback 
to approach the response under state feedback as € decreases. Figure 14.16 shows 
the opposite behavior, where the response under output feedback deviates from the 
response under state feedback as £ decreases. This is the impact of the peaking 
phenomenon. The same figure shows the control u on a much shorter time interval 
to exhibit peaking. This control peaking is transmitted to the plant causing its 
state to peak. If peaking of the state takes it outside the region of attraction, it 
could destabilize the system. Figure 14.17 shows that this is exactly what happens 
in the current case as we decrease € to 0.004 where the system has a finite escape 
time shortly after t = 0.07. 

Fortunately, we can overcome the peaking phenomenon by saturating the control 
outside a compact region of interest in order to create a buffer that protects the 
plant from peaking. Suppose the control is saturated as 


u = sat(—#3 — 2$, — #2) 
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Of = SFB 
osh --- OFBe=0.1 
OFB e = 0.01 
OFB e = 0.005 


-400 LLL n 4 L 1 
0 0.0 0,02 0,03 0.04 0.05 0.06 0.07 0.08 0.09 0.1 
t 


Figure 14.16: Performance under state (SFB) and output (OFB) feedback. 


Figure 14.18 shows the performance of the closed-loop system under saturated state 
and output feedback. The control u is shown on a shorter time interval that exhibits 
control saturation during peaking. The peaking period decreases with e. The states 
zı and r2 exhibit the intuitive behavior we expected earlier; namely, the response 
under output feedback approaches the response under state feedback as £ decreases. 
Note that we decrease £ to 0.001, beyond the value 0.004 where instability was 
detected in the unsaturated case. Not only does the system remain stable, but 
the response under output feedback is almost indistinguishable from the response 
under state feedback. What is more interesting is that the region of attraction under 
output feedback approaches the region of attraction under state feedback as € tends 
to zero. This is shown in Figures 14.19 and 14.20. The first figure shows the phase 
portrait of the closed-loop system under u = sat(—z3 — zı — T2). It has a bounded 
region of attraction enclosed by a limit cycle. The second figure shows that the 
intersection of the boundary of the region of attraction under u = sat(—23 —#, — £2) 
with the z;-r4 plane approaches the limit cycle as € tends to zero. 


The behavior we saw in Figures 14.18 and 14.20 will be realized with any glob- 


` ally bounded stabilizing function y(x). During the peaking period, the control ?(£) 


saturates. Since the peaking period shrinks to zero as € tends to zero, for sufficiently 
small e, the peaking period becomes so small that the state of the plant x remains 
close to its initial value. After the peaking period, the estimation error becomes 
O(e) and the feedback control 7(#) becomes close to y(x). Consequently, the tra- 
jectories of the closed-loop system under output feedback asymptotically approach 
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Figure 14.17: Instability induced by peaking at & = 0.004. 


. its trajectories under state feedback as & tends to zero. This leads to recovery of the 
performance achieved under state feedback. The global boundedness of Y(z) can 
be always achieved by saturating the state feedback control, or the state estimates, 


`- outside a compact region of interest. . l 
The analysis of the closed-loop system under output feedback proceeds as fol- 


lows: The system is represented in the singularly perturbed form 


$i = 22 

Zz = $(z,7(2)) 

em = —aim +m 
€ = -—o$m-teb(z,z) 


where 2, = 21 — €m and £5:— 22 — n2. The motion of the slow variables (21, 22) 
can be approximated by a slow model obtained by setting € = 0. Since € = 0 yields 
n = 0, the slow model is the closed-loop system under state feedback, given by 
(14.91)-(14.92). The fast motion of (m, 72) can be approximated by the fast model 


obtained by neglecting eô. Let V(x) be a Lyapunov function for the slow model 
and W(n) = nT Pon be a Lyapunov function for the fast model, where Pp is the 


E 
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SFB 

OFB £ = 0.1 
OFB e = 0.01 
OFB e = 0.001 


0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 01 


Figure 14.18: Performance under state (SFB) and output (OFB) feedback with satu- 
ration. 


solution of the Lyapunov equation PoAg + ATPT = —I. Define the sets Q, and 
E by Q. = {V(z) € c) and E = {W(n) < pe?), where c > 0 is chosen such that 
Qe is in the interior of the region of attraction of (14.91)-(14.92). The analysis can 
be divided in two basic steps. In the first step we show that for sufficiently large 
p, there is ef > 0 such that, for every 0 < € S ej, the origin of the closed-loop 
System is asymptotically stable and the set Q, x X is a positively invariant subset 
of the region of attraction. The proof makes use of the fact that in Qe x E, 5 is 
O(e). In the second step, we show that for any bounded $(0) and any z(0) € €, 
where 0 < b < c, there exists £3 > 0 such that, for every 0 < € € ež, the trajectory 
enters the set 2, x X: in finite time. The proof makes use of the fact that Q is in 
the interior of Qe and (2) is globally bounded. Hence, there exits a time Ti » 0, 
independent of e, such that any trajectory starting in Q, will remain in 2, for all 
t € [0, T1]. Using the fact that 7 decays faster than an exponential mode of the form 
(1/:)e7?'/*, we can show that the trajectory enters the set Q, x X within a time 
interval [0, T (e)], where lim,..o T(e) = 0. Thus, by choosing € small enough, we can 
ensure that T(e) < Ti. Figure 14.21 gives a sketch that illustrates this behavior. 
The full-order observer (14.93)-(14.94) provides estimates (£1, 22) that are used 
to replace (71,25) in the feedback control law. Since y = z; is measured, we can 
use z; in the control law and only replace z2 by 25. This approach does not change 
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Figure 14.19: Phase portrait of the closed-loop system under u = sat(—z3 -zı — T2). 


the analysis of the closed-loop system, and we obtain the same results as before. 
On the other hand, we can use the reduced-order observer 


— h(w + hy) + do($, u) (14.101) 
w + hy ‘ (14.102) 


where h = a/e for some positive constants a and € with € < 1, to estimate $2. It 
is not difficult to see that the high-gain reduced-order observer (14.101)-(14.102) 
exhibits the peaking phenomenon, and global boundedness of the state feedback 
control plays the same role as in the full-order observer case. 

The high-gain observer is basically an approximate differentiator. This point 
can be easily seen in the special case when the nominal function $e is chosen to be 
zero, for then the observer is linear. For the full-order observer (14.93)-(14.94), the 
transfer function from y to $ is 

az Eb dd » 5 ccn 
(c8)? + ayes + az 8 8 


and for the reduced-order observer (14.101)-(14.102), the transfer function from y 
to $9 is. 


Ù 


u 


$2 


p 0 
Geri tut 

Thus, on a compact frequency interval, the high-gain observer approximates ý for 
sufficiently small e. 

Realizing that the high-gain observer is basically an approximate differentiator, 
we can see that measurement noise and unmodeled high-frequency sensor dynamics 
will put a practical limit on how small € could be. Despite this limitation, there 
are interesting applications where the range of permissible values of € allows for 


successful application of high-gain observers.?” 


27Examples of application to induction motors and mechanical systems are given in [3], [47], l 


and [186]. 
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Figure 14.20: The region of attraction under state feedback (solid) and intersection 
of the region of attraction under output feedback with the x,-zy plane for € = 0.1 
(dashed) and e = 0.05 (dash-dot). | 


14.5.2 Stabilization 


Consider the multi-input-multi-output nonlinear system 


$ = Ag+ Bd(z,z,u) (14.103) 
ż = w(z,z,u) (14.104) 
y = Cx (14.105) 
Ç = q(z,z) (14.106) 


where u € RP is the control input, y € R™ and Ç € R° are measured outputs, and 
x € R^ and z € Rf constitute the state vector. The p X p matrix A, the p x m 
matrix B, and the m x p matrix C, given by 


ME EOS 0 
0 0 1 0 
A = block diag[A;,..., Am], Ai = 
^ 0 0 I1 
0 ix 
PiXPr 
0 
0 
B = block diag[Bi...., B5], Bi | : 
0 
1 pixl 
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G— 7 


Qe 


Figure 14.21: Illustration of fast convergence to the set Qe x X. 


C = block diag[Ci,...,C«], C;i2 [1 0 > ++ 0] 


1Xp, 


where 1 < i € m and p = pj + -:: + pm, represent m chains of integrators. The 
functions ¢, 7, and q are locally Lipschitz in their arguments for (z,z,u) € D, x 
D, x R?, where D, C R? and D, C R° are domains that contain their respective 
origins. Moreover, ¢(0,0,0) = 0, ¥(0,0,0) = 0, and q(0, 0) = 0. Our goal is to 
design an output feedback controller to stabilize the origin. í 

The two main sources for the model (14.103)-(14.106) are the normal form of 
input-output linearizable systems and models of mechanical and electromechanical 
systems, where displacement variables are measured while their derivatives (veloc- 
ities, accelerations, etc.) are not measured. The normal form for a single-input- 
single-output system is given by (13.16)-(13.18). It is easy to see that the equation 
takes the form (14.103)-(14.105) with z = £ and z = n.?8 If y is the only measured 
variable, we can drop equation (14.106). However, in many problems, we can mea- 
sure some state variables in addition to those at the end of the chains of integrators. 
For example, the magnetic suspension system of Exercise 1.18 is modeled by 


$i = T2 
Í Re: Loaz? 
TR TUE 2m(a + 21)? 

` 1 Lgaror3 
Rom c |-Rr4T—— 4d 
^ 7 Lm) | MECTES 


where 2 is the ball position, z is its velocity, and z3 is the electromagnet cur- 
rent. Typically, we measure the ball position zı and the current +3. The model 
fits the form (14.103)-(14.106) with (2,22) as the z component and 23 as the z 


28See [88, Section 5.1] for the multivariable normal form. 
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component. The measured outputs are y = z, and Ç = zs. Another source for the 
model (14.103)-(14.106) where (14.106) is significant arises in system in which the 
dynamics are extended by adding integrators. In Example 13.8, we saw a system 
represented by an nth order differential equation. The dynamics were extended 
by adding m integrators at the input side. Inspection of the resulting state model 
shows that it fits the form (14.103)-(14.106) with z as the states of the m integra- 
tors and z as the output and its derivatives up to y(^7J, In this case, the whole 
vector z is measured, and equation (14.106) takes the form 6-z. 

We use a two-step approach to design the output feedback controller. First, à 
partial state feedback controller that uses measurements of z and ¢ is designed to 
asymptotically stabilize the origin. Then, a high-gain observer is used to estimate 


z from y. The state feedback controller is allowed to be a dynamical system of the : 
form 


DU 
u 


T($,z, C) (14.107) 
Y (9, x, c) (14.108) 


where y and T are locally Lipschitz functions in their arguments over the domain 
of interest and globally bounded functions of z. Moreover, 4(0,0,0) = 0 and 
T(0,0,0) = 0. A static state feedback controller u = 7(z,C) will be viewed as a 
special case of the foregoing equation by dropping the 3-equation. For convenience, 
we write the closed-loop system under state feedback as 


Y = f(x) (14.109) 
where X = (2,2, 0). The output feedback controller is taken as 
8 = I(0,g,) (14.110) 
u = (9,2,C) (14.111) 
where $ is generated by the high-gain observer 
Ê= Af  Béo(£,C,u) + H(y — C2). (14.112) 
The observer gain H is chosen as 
aije 
o$/e? 
H = block diag[H,,... An), Hi = (14.113) 


i i=l 
Qpi=1/6” 


t Pi 
Qp /e pix 


where € is a positive constant to be specified and the positive constants oj are 
chosen such that the roots of 


pi ipic i Tia 
8" + ays" +e bal stat, =0 
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are in the open left-half plane, for all i = 1,..., m. The function $o(z, C, u) is a 
nominal model of ¢(z, z, u), which is required to be locally Lipschitz in its arguments 
over the domain of interest and globally bounded in x. Moreover, $o(0, 0, 0) = 0. 


Theorem 14.6 Consider the closed-loop system of the plant (14.103)-(14.106) and 
the output feedback controller (14.110)-(14.112). Suppose the origin of (14.109) is 
asymptotically stable and R is its region of attraction. Let 5 be any compact set in 
the interior of R and Q be any compact subset of RP. Then, 


e there exists c > 0 such that, for every 0 < € € ei, the solutions (& (t), £(t) 
of the closed-loop system, starting in S x Q, are bounded for all t > 0. 


e. given any u > 0, there exist e$ > 0 and Tz > 0, both dependent on p, such 


that, for every 0 < € < eż, the solutions of the closed-loop system, starting in. 


S x Q, satisfy 
Ixl se and Jets VtzT (14.114) 


e given any p > 0, there exists € > 0, dependent on p, such that, for every 
0 <e € e$, the solutions of the closed-loop system, starting in Sx Q, satisfy 


IXH- XOS vtao (14.115) 
where X, is the solution of (14.109), starting at X (0). 


e. if the origin of (14.109) is exponentially stable, then there exists e} > 0 such 
that, for every 0 < € € £1, the origin of the closed-loop system is ezponentially 
stable and S x Q is a subset of its region of attraction. 

© 


Proof: See Appendix C.23. 


The theorem shows that the output feedback controller recovers the performance 
of the state feedback controller for sufficiently small e€. The performance recovery 
manifests itself in three points. First, recovery of exponential stability. Second, re- 
covery of the region of attraction in the sense that we can recover any compact set in 
its interior. Third, the solution Æ (t) under output feedback approaches the solution 
under state feedback as £ tends to zero. For convenience, recovery of asymptotic 
stability is shown only for the exponentially stable case.2® Notice, however, that the 
first three bullets of the theorem, which show boundedness, ultimate boundedness, 
and trajectory convergence, are valid without the exponential stability assumption, 

As a-corollary of the theorem, it is clear that if the state feedback controller 
achieves global or semiglobal stabilization with local exponential stability, then for 


sufficiently small e, the output feedback controller achieves semiglobal stabilization © 


with local exponential stability. 
WC RATHER CORE , ‘ 

29See [16] for the more general case when the origin is asymptotically, but not exponentially, 
stable, 
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Example 14.19 In Section 14.1, we designed the continuous sliding mode state 


feedback controller , 
u = —k sat (aeza -2 t i) 


' with a = 1, k = 4, and p = 1, to stabilize the pendulum equation 


m? B + mgl sin 0 + kol å = u 


at (0 = m, = 0). Suppose now that we only measure 0. An output feedback 


controller can be taken as l 
u = -k sat (ad mas) i 


` 


where Ê and à are the estimates of 0 and w == 6 provided by the high-gain observer 


>- 
ll 


à + (2/e)(0 — 6) 
$o (6, u) + (1/e?)(0 — ô) 


where óo = —asin6 + ĉu is a nominal model of ¢ = —(go/é)sin9 — (ko/m)Ó + 
(1/mé)u in which â and é are nominal values of (go/£) and (1/m4?), respectively, 
while the nominal value of the coefficient of friction kọ is taken to be zero. The 
observer is designed to have multiple poles at —1/e. In Figure 14.22, we compare the 
performance of the state and output feedback controllers for e = 0.05 and € = 0.01. 
The pendulum parameters are m = 0.15, £ = 1.05, and kg = 0.02 and the initial 
conditions are 0(0) = 7/4 and w(0) = 8(0) = (0) = 0. We consider three cases 
for the observer. In the first case, the observer uses the nominal values à — 9.81 
and é = 10, which correspond to the nominal parameters rh = 0.1 and f= 1. In 
the second case, we use à = 9.3429 and é¢ = 6.0469, which correspond to the actual 
parameters; that is, rh = m = 0.15 and f£ = £ = 1.05. In the third case, we use a 
linear observer by setting à = ĉ = 0. In all cases, we see that the response under 
output feedback approaches the response under state feedback as e decreases. When 
€ is relatively large, we see an advantage for including ġo in the observer when it is 
a good model of ¢. However, if the model is not that good, a linear observer may 
perform better. The important thing to notice here is that the differences between 
the three observers diminish as & decreases. This is expected, because decreasing € 
rejects the effect of the uncertainty in modeling ó. A 


g- 
D 


14.5.3 Regulation via Integral Control 
Consider the single-input-single-output system 

t = f(z,w)* g(x, w)[u + ó(z, u, w)| 
y h(z. w) 
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(b) 


— SFB 
.-. OFB e= 0.05 
-- OFB £20.01 


Figure 14.22: Comparison of state feedback (SFB) and output feedback (OFB) for 
Example 14.19. Figures (a) and (b) show @ and w = @ for a nonlinear high-gain 


- observer with nominal m and £. Figure (c) shows 0 for a nonlinear high-gain observer 


with actual m and £. Figure (d) shows 0 for a linear high-gain observer. 


where x € R” is the state, u € R is the control input, y € R is the controlled as 


well as measured output, and w € R! is a vector of unknown constant parameters ` 


and disturbances. The functions f, g, h, and 6 are sufficiently smooth in (x, u) and 
continuous in w for z € D C R^, u € R, end v € D, C Rl, where D and Dy are 
open connected sets. We assume that the system 


i f(x, w) + g(s, w)u 
y h(z,w) 
has relative degree p in D uniformly in w; that is, 
Ljh(z,w) = +++ = Lg ^ h(z,w) = 0, LL, M h(z,u) 2a» 0 


for all (z,w) € D x Dy. Our goal is to design an output feedback controller such 
that the output y asymptotically tracks a constant reference r € D, C R, where D, 
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is an open connected set. 

This is the output feedback version of the problem we studied in Section 14.1.4. 
The only difference is that we allow f and h to depend on w, while in Section 14.1.4, 
they were restricted to be independent of w. The restriction was needed there be- 
cause the variables h, Dh, ... Dh were used to compute the state feedback con- 
trol. In the output feedback case, these variables are calculated from the measured 
signal y by using a high-gain observer. Because we allow f to depend on w, the 
term ài has been absorbed in f. We are not going to repeat the assumptions and 
derivations of Section 14.1.4. Let us only recall the sliding mode state feedback 
controller (14.29), namely, 


ép = e 
ESOS (= + kier + k2e2 o + kp-1€p-1 + :j 
m 
where e; = y —r is the regulation error and es to e, are the derivatives of e1.99 The 
control is globally bounded and the signal e; is available on-line. To implement this 


controller using output feedback, we estimate eo to e, by utilizing a linear high-gain 
observer. Thus, the output feedback controller can be taken as 


é = € 
Sigh) adus akeat (matas + k2ê2 Tot t kpo-iêp-1 +e) 
u 
A A Qi A ; 
êi = yi t+ (S) (q-à) l1siszp-1 


A Qp M 
& - (S)e-2 
where the positive constants a; to a; are chosen such the roots of 
s? 045773 as 15 a, =0 


have negative real parts. For relative-degree-one systems (p = 1), the high-gain ob- 
server is not used. Under the assumptions of Section 14.1.4, the closed-loop system 
under state feedback has an exponentially stable equilibrium point at (z,eo,e) = 
(0,29, 0). We leave it to the reader (Exercise 14.50) to verify that, for sufficiently 
small £, the output feedback controller recovers the performance of the state feed- 


. back controller. 


14.6 Exercises 


14.1 Consider the system 


£2 = 2 + (1 + 62)u, y=21 


30We have written the sliding mode boundary-layer parameter as z to reserve & for the high-gain 
observer parameter. 


ii = z3 + sin 23, 
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where |01] < 2 and |02] x 1/2. Using sliding mode control, 
(a) design a continuous state feedback controller to stabilize the origin. 


(b) design a continuous state feedback controller so that the output y(t) asymp- 
totically tracks a reference signal r(t). Assume that r, 7, and ? are continuous 
and bounded. 


14.2 A simplified model of an underwater vehicle in yaw is given by (60] 
b+ abil =r 


where V) is the heading angle, 7 is a normalized torque input, and a is a positive 
parameter. It is desired that 4% tracks a desired trajectory V (£), where v. (t), h(t), 
and #,(£) are bounded functions of t. Let à = 1 be the nominal value of a. 


(a) Using zı =~ and za = qas state variables, u = 7 as control input and y = V 
88 output, find the state model. 


(b) Show that the system is input-output linearizable. 


(c) Assuming that a = à = 1, use feedback linearization to design a state feedback 
controller that achieves global asymptotic tracking. 


(d) Assuming that |à — a] < 0.01 and v.(f) = sin2t, show that the controller 
designed in part (c) will achieve asymptotic tracking with tolerance |p(t) — 
vr(t)| € ôi and estimate 5. Is this tolerance achievable for all initial states? 


(e) Assuming that l& — a| < k, where k is known, design a state feedback controller 
to achieve global asymptotic tracking with tolerance |V (t) — v.(t)| < 0.01. 


14.3 ([176]) Consider the controlled van der Pol equation 
$j:323, dy = —way + ew(1 — p22?) rou 
where w, €, and p are positive constants and v is the control input. 


(a) Show that for u = 1, there is a stable limit cycle outside the surface z2--22/w? = 
1/u? and for u = —1, there is an unstable limit cycle outside the same surface. 


(b) Let s = 2? + 22/5? —7?, with r < 1/p. Show that restricting the motion of the 
system to the surface s = 0 (that is, s(£) = 0) results in a harmonic oscillator 


dy = 2, d= wn 
which produces a sinusoidal oscillation of frequency w and amplitude r. 


(c) Design a state feedback sliding mode controller to drive all trajectories in the 
band [ry] € 1/j to the manifold s = 0 and have thei slide on that manifold. 
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(d) Simulate the response of this system for the ideal sliding mode controller and 
for a continuous approximation. Use w = p =€ = 1. 


14.4 Consider the system 
ij-z2-azrj,sinzii, t2 = bzir2 +u 


where a and b are unknown constants, but we know the bounds |a — 1| € 1 and 
|b — 1| € 2. Using sliding mode control, design a continuous globally stabilizing 
state feedback controller. 


14.5 The equation of motion for a pendulum whose suspension point. is subjected 
to a time-varying, bounded, horizontal acceleration is given by 


m6 + mgsin6 + klå = T/£+ mh(t) cos 0 


where A is the horizontal acceleration, T is the torque input, and the other variables 
are defined in Section 1.2.1. Assume that 


O9<2<11, O5<m<15, OS k<02, fAlt)| <1 


and g = 9.81. It is desired to stabilize the pendulum at @ = 0 for arbitrary initial 
conditions 6(0) and 6(0). Design a continuous sliding mode state feedback controller 
to achieve ultimate boundedness with |0] < 0.01 and JÊ] < 0.01. 


14.6 ([108]) Consider the system 
Íi = zito, di3-—zijcu 


(a) Using sliding mode control, design a continuous globally stabilizing state feed- 
back controller. 


(b) Can you globally stabilize the origin via feedback linearization? 
14.7 Consider the system 
ii = -z + tanh(zz), 19—z2-c-z3, i3-—ud ó(x) 


where ó(z) is an uncertain function that satisfies lé(z)] € e(z) for all æ, for some 
known function g. Design a continuous sliding mode state feedback controller such 
that, for all |z(0)||;; < k, x(t) is bounded and [z1(t)| is ultimately bounded by 
0.01. 


14.8. The tank system of Example 12.5 (with integrator included) is given by 


i= Galt evi, by -r 


p 
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where r is a desired set point. Let ĉ and A(y) be nominal models of c and A(y), 
respectively, and suppose that you know positive constants 9; > 0, 0» > 0, 03 > 0, 
and 0 € o4 < 1 such that i 


01S Aly) o, lé—-c| X03 and 


Using sliding mode control, design a continuous state feedback controller such that 7 


all state variables are bounded and |y(t) — r| converges to zero as t — oo. 


14.9 Consider the system (14.1). 


(a) Let B be a constant matrix of rank p. Show that there is an n x n nonsingular 
matrix M such that MB = [0, I,]7, where I, is the p x p identity matrix. 
Verify that T(x) = Mz satisfies (14.2). 


(b) Let B(z) be a smooth function of z and assume that B has rank p for all 
z in a domain D C R^. Let A = span(b;,..., 55), where b),...,bp are 
the columns of B. Suppose A is involutive. Show that for every zo € D, 
there exist smooth functions ¢;(z),...,¢n-p(x), with linearly independent 
differentials 0$1/02,...,09,—,/0r at ro, such that [09;/Oz]B(z) = 0 for 
1<i<n-—p, Show that we can find smooth functions $,..,41(z),... (x) 
such that T(z) = [¢i(z),...,¢n(z)|” is a diffeomorphism in a neighborhood 
of xo and satisfies (14.2). 
Hint: Apply Frobenius theorem. 


14.10 Consider the nonautonomous regular form 
= falt, E) + a(t, €) 
€ folt. n, £) + G(t, x) E(t, z)u + ó(t, m, u) 


where, for all (t, x£) € [0, 0o) x D, E is a known nonsingular matrix with a bounded 
inverse and G is a positive diagonal matrix whose elements are bounded away from 
zero. Suppose there is a continuously differentiable function (t, 7), with $(,0) = 0, 
such that the origin of 7j = fa(t,n, o(t,7)) + ôn (t, n, O(t,7)) is uniformly asymptoti- 


cally stable. Let 
= 1, — — — — — 
u=E | u(h z: 55^ +v 


where L = G~! or L = 0 and Ó(t,z) is a nominal model of G(t, x). Let 


E 8$ 06 06 
A-ü-en(n- m - Sen) os, 
Suppose A; satisfies the inequality (14.10) with o = o(t,z). Taking s = € — ¢(t,n), 
design a sliding mode controller to stabilize the origin. State and prove a theorem 
similar to Theorem 14.1. 
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14.6, EXERCISES 
14.11 Suppose (14.13) is replaced by 


v; = — p(z) o (3) 


E 


where ø : R — R is a continuously differentiable, odd, monotonically increasing 
function with the properties 


^ 


o(0)=0, limc(y-1, and yo(y) > o(1)y?, v|y <1 
(a) Verify that o(y) = tanh(y), o(y) = (2/7) tan-! (my/2), and o(y) = y/(1+ |yl) 
satisfy the foregoing properties. 


(b) Show that if (14.10) is satisfied with xo < (1) and £ is chosen to satisfy 
elz) 
» M 
B(x) > ES + fo, Bo >0 
then f 
818; < —goAo[o(1) — rollsil, for |s;| > e 


(c) Prove Theorems 14.1 and 14.2 for this sliding mode control. 
14.12 Replade inequality (14.10) by 


1 


. p 
PELO +Y gl Visi< 


j=l à 


Let K bethe pxp matrix whose elements are Kij and suppose I — K is an M-matrix.?! 


Recall from the properties of M-matrices that the following three conditions are 
equivalent;3? 


(i) I-K is an M-matrix. 
(ii) I — K is nonsingular and all elements of (I ~K)? are nonnegative. 


(iii) There is a vector w whose elements are all positive such that the elements of 
b = (I — K)w are all positive. 


Let 6;(z) > o; (z) for alll < i < p and a(x) = (1 — K) [ix (z),... :Bp(z)]T. 


(a) Show that v; = —fi(z) sgn(s;) with Ai(z)  c;(z) + w; yields siå; < — igolsil 
forl<i<p. 


(b) Suppose P» Kij S Ko < land oi(z) = o(z) for 1 € i € p. Show that 1 — K is 
an M-matrix and gi(z) and w can be chosen to produce the control (14.11). 


"nci ee SEC ML 
318ee Lemma 9.7 for the definition of M-matrices. 


328ee [57]. 
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14.13 With reference to the "continuous" sliding mode controller of Section 14.1.3, 
show that there exists a finite time T, possibly dependent on € and the initial 
states, and a positive constant k, independent of € and the initial states, such that 
ly(t) — r(£)| € ke for all t > T. 


14.14 Repeat Exercise 14.5 using Lyapunov redesign. 
14.15 Repeat Exercise 14.8 using Lyapunov redesign. 


14.16 Use the Numerical data of the pendulum equation in Section 14.1.1 to 
simulate the Lyapunov redesign of Example 14.5. Choose the design parameters 
of the Lyapunov redesign to obtain the same control level as in the sliding mode 
design. Compare the performance of the two controllers. 


14.17 For each of the scalar systems that follow, use the nonlinear damping tool 
to design a state feedback controller that guarantees boundedness of the state x(t) 
as well as uniform ultimate boundedness by an ultimate bound u. The function 
6(t) is bounded for all t > 0, but we do not know an upper bound on |é(t)]. 


(a) ¢=-a2+27[u+4(t)], (b) z2z?[ + 8(0] — zu 


14.18 Consider a single-input-single-output system in the norinal form (13.16)- 
(13.18) and suppose (13.16) is input-to-state stable. Let &(x) and 4(x) be nominal 
models of the functions a(x) and (x), respectively, and suppose the modeling errors 
satisfy the inequalities 


a(x) - oz) 
(2) 


where the function po(x) and the constant k are known. Let r(t) be a reference 
signal and suppose r and its derivatives up to r(^? are continuous and bounded. 
Using Lyapunov redesign, design a continuous state feedback controller such that the 
output y asymptotically tracks r with prespecified tolerance u; that is, |y(t)—r(t)| € 
H for all t > T for some finite time T. 


ly(z)[&(z) - a(z)]| € po(z), «k«1 


14.19 Repeat the previous exercise for the case of constant reference, using integral 
control. Verify that the regulation error converges to zero. 


14.20 Consider the system 
ii-—429, £2 =ut d(z) 


where ô is unknown, but we know an estimate p; such that |6(x)| < pil|zll2. Let 
u = (x) = —zi — £2 be the nominal stabilizing control, and 


—pillella(w/llwlle), — if prllzlellwlle 2 € 


-pilzlia(w/e), if eillzllalwlla < € 
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where w^ = 2z7 PB and V(x) = x7? Pz is a Lyapunov function for the nominal 
closed-loop system. Apply the control u = —21 — x2 + v. 


(a) Verify that all the assumptions of Corollary 14.1 are satisfied, except (14.45), 
which holds with no = 0. 


(b) Show that when ó(z) = 2(z1 + Z2) and pi = 22, the origin is unstable. 


14.21. Assume that (14.33) through (14.35) are satisfied with ||- |o». Consider the 
following continuous approximation of the discontinuous control (14.40): 


—n(t,z) sgn(wi), if n(t, 2) [wil 2 € 
v = 
—P(t,z)(wi/e), if n(t,2)\wil «e 
for i= 1,2,...,p, Where wT = [0V/0z]G(t, z). 
(a) Show that l 
2 (t, z)]wi? 


y 7 
V «esl € Y pedal- 
iel l 
where i € I if (t, z)]wi] < €- 
(b) State and prove a theorem similar to Theorem 14.3 for the current controller. 


14.22 Consider the controller of Exercise 14.21. We want to prove a result similar 
to Corollary 14.1. Assume that as(lizllso) 2 ?(z), n(t,2) 2 "o > 0. and 


lái] € pi¢(z) + xolvs], OS KO «1 


for i = 1,2,...,p. These inequalities imply that (14.35) holds with || - ||», but they 
are more restrictive because the upper bound on [8;| depends only on |vil. 


(a) Show that 
" 
vs-eos y [-a- roj ZË + soa} 
i€ 
(b) State and prove a result similar to Corollary 14.1. 
14.23 Suppose the inequality (14.35) takes the form 
llé(t, z, Y(t, x) + v)l» < Po + polz) + Kollulla, 0 < Ko < 1 


where ó(z) = V/as(llzlla). Let n(z) = o + melz), where 7e 2 po/(1 — Ko) and 
m > pi/(1— &o). Consider the feedback control 


-io + mé(z))w/lwlla), — i£ lwl 2 € 
v= 


—[no + mé(z))(w/e), if ||wlla < € 


X 
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(a) Show that the derivative of V along the trajectories of the closed-loop system 
(14.38) satisfies 
V < -d(a) + io + idt] x — Last] + SH + R 
= 4 po T Pi 279 3 2/7* 732 4 


(b) Apply Theorem 4.18 to arrive at a conclusion similar to Theorem 14.3. 
(c) Compare this controller with (14.41). 


14.24 Consider the problem treated in Section 14.2 and essume that (14.35) is 
satisfied with 2-norm. Suppose further that (14.44) and (14.46) are satisfied. Show 
that the control law : 


ov 
= eas T m 
u =Ņ(t,z)- yw; w Aa Git, x) 


with sufficiently large y will stabilize the origin. 


14.25 Consider the problem treated in Section 14.2. Show that, instead of using 
the control law u = p(t, £) +v, we can simply use u = v, whore p(t, z) is taken from 
the inequality 


\|6(t, z, u) — v(tz)lla € p(t, £) + Kollulle, 0 S Ko <1 


14.26 Suppose that, in addition to the matched uncertainty 6, the system (14.30) 
also has unmatched uncertainty A; that is, 


å = f(tz) + A(t, £) G(tz)[u + (ta, u)] 


Suppose that, over a domain D C R”, all the assumptions of Theorem 14.3 are 
satisfied, the inequalities (14.44) through (14.46) are satisfied, and the unmatched 
uncertainty satisfies |||DV/Oz]A(t, z)|l2 € u(x), for some p > 0. Let u = v(t,z)-- 
v, where v is determined by (14.41). Show that if x < 1, then the feedback control 
law will stabilize the origin of the closed-loop system provided that the £ chosen is - 
small enough to satisfy € < 4(1 — u)(1 — ro)}ng/ 0. 


14.27 Consider the system $ = f(r) + G(z)[u + ó(z, u)], and suppose there are 


known smooth functions (x), V(x), and p(z), all vanishing at z = 0, and a known 
constant k such that 


alal? v) sell, D f) GGG) < -elal 


\|6(x, v(x) + v)l| € p(x) + solel, OS ^o«1, Yzer”, Vue RP 


where c to c3 are positive constants. 


(a) Show that it is possible to design a continuous state feedback controller u -= 
+(x) such that the origin of 


& = f(x) + G(z)[v(z) + &(z, (2))] 


is globally exponentially stable. 


(b) Apply the result of part (a) to the system d 
= 22, 2 = (1+ a )(2] +13) + (1+ a2)u 
where a; and ag are unknown constants that satisfy |a; | <1 and [ao] < 1/2. 
14.28 Repeat exercise 14.1 using backstepping. 
14.29 Repeat exercise 14.5 using backstepping. 
14.30 Repeat exercise 14.6 using backstepping. 


14.31 Using backstepping, design a state feedback controller to globally stabilize 
the system 


$j- tg tat (x, — a”), t =z; +u 
where a is a known constant. 
14.32 ([108]) Consider the system 
ti —23-— $21 - ici, fg=u 
(a) Using backstepping, design a linear state feedback controller to globally sta- 
bilize the origin. 


Hint: Avoid cancellation of nonlinear terms. 


(b) Design a globally stabilizing state feedback controller by using feedback lin- 
earization. 


(c) Compare the two designs. Using computer simulations, compare their perfor- 
mance and the control effort used in each case. 


14.33 Consider the system 
i =r} dg=0,-23+u 


(a) .Find a smooth state feedback controller u = p(x) such that the origin is globally 
exponentially stable. l 
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(b) Extend the dynamics of the s ind i 
ystem by connecting an integrat les wi 
the input, to obtain : poner 


Ti = 22, bo =z,- r} +2, 2v 


Using backstepping, find a smooth state feedback c 
e NU ontroller v = ó(z, 
that the origin is globally asymptotically stable. pps 


14.34 Consider the system of Exercise 13.17. 


(a) Starting with the z;-equation and stepping back to the d-equation, design a 
state feedback controller u = (x) such that the origin (x1 = 0, z2 = 0) of 
the first two equations is globally exponentially stable. 


(b) Show that, under the feedback controller of part (a), the origin z = 0 of the 
full system is globally asymptotically stable. 
Hint: Use input-to-state properties of the third equation. 


14.35 Consider the system 
di—ip4Ór], fg =a3tu, $3=T -T3 y=ry 
where 6 € [0,2]. Using backstepping, design a state feedback controller such that 


|y — asin t] is ultimately bounded by y, where p is a design parameter that can be 
chosen arbitrarily small. Assume that |a| € 1 and [[z(0)]|os < 1. 


14.36 Repeat exercise 14.4 using a combinati f i 
eee g nation of backstepping and Lyapunov 


14.37 Consider the system 
tı = —T1 + 1229, $2 = T2 + T3, i3 = 23 +(x) +u 
where ó(z) is an unknown (locally Lipschitz) function of x that satisfies |ó(z)| < 


k||z |a for all z, with a known constant k. Design a globally stabilizing state feedback 
controller. l 


14.38 Consider again Exercise 14.7. 


(a) With 6 = 0, use backstepping to design a globally stabilizing state feedback 
controller. 


(b) Use the stabilizing controller of part (a) and Lyapunov redesign to design a 
state feedback controller such that, for all |z(0)||oo < k, z(t) is bounded and 
|r (t| is ultimately bounded by 0.01. 


14.6. EXERCISES 


14.39 Consider the magnetic suspension system of Exercise 1.18 and suppose the 
ball is subject to a vertical disturbance force d(t); that is, 


mj = —ky + mg + F(y,i) + d(t) 
Suppose further that |d(£)| < do for all t > 0, where the upper bound do is known. 


(a) Viewing the force F as the control input, use Lyapunov redesign to design & 
state feedback control F = y(y,y) such that ly — r| is ultimately bounded 
by p, where p is a design parameter that can be chosen arbitrarily small. 
Design your control such that 7 is a continuously differentiable function of its 
arguments. i 


(b) Using backstepping, design.a state feedback control law for the voltage input 
u that will ensure that |y — r] is ultimately bounded by 4. 


14.40 Consider the system 4 


ii-2-rict zl [x2 + ó(t)], i2-—u 


where 6(t) is a bounded function of.t for all t > 0, but we do not know an upper 


bound on |é(t)|. By combining backstepping and the nonlinear damping tools, 
design a state feedback controller that ensures global boundedness of the state z 
for all initial states z(0) € R?. 


14.41 Repeat Exercise 14.40 for the system 
i = -zuzàcji-aét) t2=4 


14.42 Consider the linear system $ — Ax 4- Bu and suppose there exists a positive 
definite symmetric matrix P such that PA + ATP < 0 and the pair (A, B7 P) is 
observable. Design a globally stabilizing state feedback control law u = —wV(x) such 
that ||v(z)]| < k for all z, where k is a given positive constant. 


14.43 Consider the system 
tı = 22, go = —23 + V(u) 


where 4 is a locally Lipschitz function that satisfies (0) = 0 and up(u) > 0 for all 
u #0. Design a globally stabilizing state feedback control. 


14.44 Consider a relative-degree-one, single-input-single-output system with a 
globally defined normal form 


h= famy) v= (ny) +alny)u 
where fo(0,0) = 0 and a(n, y) 2 ao > 0. Suppose there is a (known) radially un- 


bounded Lyapunov function W (7), with [AW/dn\(0) = 0, such that [2W/8] fo(n, 0) < 


0 for all 7 #0. Design a globally stabilizing state feedback controller. 
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14.45 Design a passivity-based globally stabilizing state feedback control for the - 
system of Example 13.17. 
14.46 Design a globally stabilizing state feedback control law for the system 
ży = -(1-z3)0]. t2=23, $5 -s22-1-4u 


14.47 Consider a relative-degree-one, single-input-single-output system that is 
represented, in some domain that contains the origin, by the normal form 


4=folny), y= (ny) + aln, y)u 
where fo, a, and b are sufficiently smooth, a(n,y) 2 ao > 0, fo(0,0) = 0, and 


b(0,0) = 0. Suppose the origin of 7j = fo(n,0) is asymptotically stable and there is 
a Lyapunov function V(r) such that 


ox (Inl) € V(») € os(Ilnl) and fot.) < -oes(Inl), Y iml 2 (9D 


for some class K functions a, a2, a3, and y. Let à(y) and b(y) be smooth nominal 
models of a(n, y) and b(n, y), respectively, such that à(y) > ĉo > 0 and 


(my) — bly) 
a(my) . à(w) 


< aly) (14.116) 


over the domain of interest, where o(y) is known. The choice à = 1, b = 0 is 
possible. 


(a) Show that a continuous stabilizing sliding mode controller can be taken as 
b(y) y 
=- —— -= ti= 
ua Pus (2) 


where 3(y) > oly) + Go, for some positive constants € and ĝo. In particular, 
show that there are compact positively invariant sets Q and Qe = (Vis 
a(e), ly] € €) CQ, for some class K function a, such that every trajectory 
starting in f? enters Ne in finite time. 


(b) Show that if the origin of = fo(n,0) is exponentially stable, then for suffi- 
ciently small e the origin of the closed-loop system is exponentially stable and 
Q is a subset of its region of attraction. 


(c) Show that (14.116) can be satisfied on any compact set with a constant g. 


(d) Under what conditions will this controller achieve semiglobal stabilization? 


14.6. EXERCISES 


^ a c 


(e) Design a stabilizing output feedback controller for the system 
$,--—2 - 23, t = —23—23- u, $3 =a? — 25 +1, yz. 
14.48 Consider the p-input-p-output system 
$-—f(zu, y-h(z) 


where f is locally Lipschitz, h is continuously differentiable, f(0,0) = 0, and h(0) = 
0. Suppose the system 


= feu), = 2 yew E insu) 


with output j, is passive with a radially unbounded, positive definite storage func- 
tion V(x); that is, V < uy, and is zero-state observable. Let z; be the output 
of the linear transfer function b;s/(s + aj) whose input is y;, where a; and b; are 
positive constants. 


(a) Using V(x) + 321.4 (4i/2b;)2? as a Lyapunov function candidate, show that the 
output feedback control u; = —k;z;, 1 € i € p, k; > 0, globally stabilizes the 
origin. : 

(b) Using V(z]-- 571i (1/b:) [o di(e) do as a Lyapunov function candidate, where 
@; is a locally Lipschitz function such that ¢;(0) = 0 and o¢;(o) > 0 for 
all ø £ 0, show that the output feedback control u; = —éi(z) 1 < i < p, 
stabilizes the origin. Under what conditions on d; will this control law achieve 
global stabilization? 


(c) Apply the result of part (a) to globally stabilize the pendulum equation 
m6 + mgsin§ = u 
at the angle 0 = 6; by using feedback from 0, but not from Å. 


14.49 Consider the system (14.85)-(14.86) and suppose u = y(z) is a locally 
Lipschitz state feedback control that globally stabilizes the origin. Let $ be the 
state estimate provided by the observer (14.87). Show that the output feedback 
control u = 4(£) globally stabilizes the origin (x = 0,$ = 0) of the closed-loop 
system if the system : 

z= Ar + g(Cz,y(z — v)) 


with input v, is input-to-state stable. 


14.50 Verify that the output feedback controller of Section 14.5.3 recovers the 
performance of the state feedback controller for sufficiently small e. In particular, 
show that the closed-loop system under output feedback has an exponentially stable 
equilibrium point at (z, €o, e, ê) = (0, Eo, 0,0). 
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In the next seven exercises, we present a few case studies. 
14.51 A current-controlled induction motor can be modeled by? 


Jù = ke (Agip — Abia) — Ty 


i R RLM 

À = E = — d 
a L, Aa — pw àb + T, la 
n R RM , 
À = = I Ab + pwda + L, ib 


where w is the rotor speed, Ty is the load torque, A, and A, are the components 
of the rotor flux vector, i, and à are the components of the stator current vector, 
L, and M are the rotor and mutual inductances, R, is tlie rotor resistance, J is 
the moment of inertia, p is the number of pole pairs, and k, is a positive constant. 
The load torque Tz, can be taken as Ty = T, + ó(w), where ¢ € [0, oo] is a locally 
Lipschitz function that models the load due to friction, while T, models the speed- 
independent load. The currents ia and iy are the control variables. It is desired 
to design feedback control so that the speed w tracks a reference speed w, in the 
presence of unknown load: torque. In this exercise, we will pursue the design by 
transforming the equations into field-oriented coordinates. This transformation 
decouples the control problem into two separate control problems, one for the speed 
and the other for the rotor flux. The transformation should be applied on-line aiid 
requires measurement of the rotor flux. We will start by assuming that the rotor flux 
is available. Then we will use an observer to estimate the rotor flux and analyze the 
performance of the controller when the rotor flux is replaced by its estimate. The 
analysis will take into consideration uncertainty in the rotor resistance R,, which 
may change significantly with temperature during the operation of the motor. 


(a) Let p be the angle of the rotor flux vector and Aa be its magnitude; that is, 
p = t&n71 (44/À) and A, = Vd? + XI. Replacing Aa and Ab by Ag and p as 
State variables and transforming i, and i, into ig and tg, defined by 


ta —| œs sinp pn : (14.117) 
iq —sinp cosp ip i 


show that the motor can be represented by the state model 


R,Mi, 
Lou 


, . : R M, ; 
Jù =k MiQ-T, Aas- eat id P= pw + 
L, L, 
provided A, > 0. 


(b) The first two equations of the foregoing model are independent of p. Therefore, 
to design the feedback control laws for ía and iq, we can drop the state equation 
for p. However, we still need p to calculate ia and iy by using the inverse of 
the transformation given by (14.117). Show that for constant w, iq, and Aq, p 
will be unbounded. Explain why an unbounded p does not cause a problem. 


RE neni e Ru US M eT 
33See, for example, [50, Appendix C] or [117]. 
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(c) Note that the torque generated by the motor is proportional to Aut. Therefore, 
we can control the speed by first regulating Aq to a desired constant flux Ar 
using the control input ig; then we can design iq assuming Aq = Àp. This 
assumption will be justified if the dynamics of the flux loop are much faster 
than the dynamics of the speed loop.*4 In this part of the exercise, we design 
the flux control. Show that ig = (A./M) — k(Ag — Ar), with k > 0, achieves 
the desired regulation. 

i urrents ig and iy must be limited to certain maximum values, in 

v poni. we would like to assume that ig and iq are limited to Ig e M 
respectively. Show that if Jy > A./M and 0 < Aq(0) < Ar, then under the 
saturated control 


M — k(àa — Àr 
ia = Ig sat (25958 MP) (14.118) 


Aa(t) changes monotonically from A4(0) to A. Estimate the settling time. 


(e) For speed control, let us assume that w,(t), o» (t), and T,(t) are ee 
Design a sliding mode controller of the form i, = —I, sat(s/e) wit Arial 
priately chosen s and e. Give conditions under which the controller will wor 
and estimate the ultimate bound on the tracking error. 


i iti the foregoing assumption, w,(t) satisfies lim;oo w(t) = 

i dua E 0 and rin iiem to achieve zero steady-state error a 

To is constant. Using integral control, design a sliding mode RET e 

form i, = —J, sat(s/e) with appropriately chosen 8 and E. Give condi FA 

under which the controller will work and verify that it achieves zero steady- 
state error. : 


(g) The assumption that the rotor flux can be measured is not a practical one. In 
applications, it is common to estimate the flux by using the observer 


" R, 


HM e dm Ep L ip 


where Ê, is a nominal value (or estimate) of R,. The field Orientation angle 

p and the flux magnitude A4 are calculated by using p = tan 1 (Aj/A4) and 

Aq = NY. + 52; i4 and i4 are defined by using (14.117) with the newly «e. 

p. To write down a state model for the overall system, we define the flux 
' estimation errors e4 and eq by 


ea | _ [| cosp sA Lx] (14.119) 
e | | -sinp cosp Ab — Ab 


34This can be justified by the singular perturbation theory of Chapter 11. 
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Using w, Aq, p, €a, and e, as state variables, show that the overall system can 
be represented by the state miodel 


Jo = ky(Agig + gid — egiq) ^ Tr, 


Ê, RM , 
Ad = — pa Aa LOU 
n R.Mi, 
P I 
Rr R,Mi R, = R, Bin 
áo = o -ytet LÀ. e, + L, ) (Mia — A4). 
. Ê Mig ^ R. R, - R, Mi 
& = — Ig ed L Eq + L. q 


(h) Verify that the flux control (14.118) still regulates Ag to À~, provided Ia > A./M 
and 0 < A4(0) < àr. Furthermore, show that 


IMis(t) — A«(t)] < (1+ EM)[M Ta — A«(0)] exp[- (s /L-)t] 
(i) Using V = (1/2)(e2--e2) and the comparison lemma, show that |lel| = ,/e3 + e2 
satisfies the bound ; i 


Ê, — Rp 
R, 


lle(£)]l € k1e™™ + ka. 


for some positive constants y, kı, and kg. 


(j) Find conditions under which the sliding mode controller with integral action, 
designed in part (f), will still achieve zero steady-state error. 


14.52 The nonlinear dynamic equations of an m-link robot are given by 
M(a)i + C(a,à)d + Då + gla) =u (14.120) 


where all variables are defined in*Exercise 1.4. We assume that M , C, and g are 
continuous functions of their arguments and 


0«AsyTy x yTM(ay €Auy y, | Vae R^, y #0 


for some positive constants Am and Aas. We want to design a state feedback control 
law such that q(t) asymptotically tracks a reference trajectory q,(t), where ar(t), 
d. (f), and g,(t) are continuous and bounded. In this exercise, we design a sliding 


E S * <. We See 
-e * $ £25 . " ves rn 
` CA. ts Mec 
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mode controller. Take the sliding surface as s = Ae +è = 0, where A is a positive 
diagonal matrix, and let 
u= M(q)u + L(C(a, d)à + (a) + M (a). — M (g)Ad] 


where M, Ó, and ĝ are nominal models of M, C, and 9, respectively, and Z is either 
zero or identity, leading to two different control laws. 


2 


(a) Show that s satisfies an equation of the form 


$ — v A(g,d, dr: dr des v) 
and give expressions for A when L = 0 and L — I. 


(b) Assuming that 


IA- (g)M(g) - Ilo «ko «1, VqeR" (14.121) 
show that A; satisfies the inequality 
AS aC) rolls forisism 
, Where p may depend on (4,6, qr, drs d). 
(c) Let — 
vi = —A(-) sat(s;/e), €>0, forl<i<cm 


where 8 may depend on (q, d, qr, gr; Gr). Show how to choose £ to ensure that 
the error e is globally uniformly ultimately bounded and give an estimate of 
the ultimate bound in terms of e. 


(d) What properties can you prove for the sliding mode controller when B is taken 
as & constant? 


14.53 Consider the m-link robot of the previous exercise, In the current exercise, 
we derive a different sliding mode controller [180] that uses the skew symmetric 
property of (M — 2C) and avoids the condition (14.121). 


(a) Taking s as in the previous exercise and W = (1/2)s™M (g)s as a Lyapunov 
function candidate for the é-equation, show that 


W = s™[MAé + C(Ae — à.) — Då - g - MG, + u] 
(b) Let , 2 : 
uz v-t L[-M(g)Aé ~ C(q, d)(Ae — à.) + 9(q) + M (a)à-] 
where L 2: 0 or L=], leading to two different control laws. Show that 
W= sT[v t A(q,á, dr; dr, à-)] 


and give expressions for A when L — 0 and L = I. 


2 
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(c) Let 


2, f 
E TE e let 


V; for |[yll2 < 1 
where ( may depend on (4d, dr Èr, Ë). Show how to choose B to ensure that 


the error e is globally uniform] i i 
€ y ultimately bounded and give an esti 
the ultimate bound in terms of e. j SIM 


(d) What properties can you prove for the slidi 
ng mode trol ; 
as a constant? 8 controller when is taken 


Load 


Figure 14.23: Two-link robot. 


14.54 The two-link robot, shown in Figure 14.23 can b deled 
tion (14.120) with j ET ADRESSE 


M= 4j--2a4cosqo az + a4cosqz = i -do -lå +ġ 
ees a3 | Casing, à E i 


g= | by cos qi + b2 cos(q, + q2) 
b; cos(q1 + q2) 


where a4 through a4, b1, and bz are positive constants which depend on masses, 
moments of inertial, and lengths of the two links, as well as the acceleration due 
to gravity. We neglect damping and take D = 0. Let the nominal values of the 
parameters be 


@ = 200.01, a» = 23.5, a3 = 122.5, a4 = 25, b, = 784.8, b2 = 245.25 


i 
| 
t 
| 
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To move the arm from the initial position (gy = 0, qo = 0) to the terminal position 
(m = 7/2, q2 = 7/2), we take the reference trajectory as 


qa (t) = Gra(t) = (7/2)[1 — exp(—5é)(1 + 5t)] 


We assume that the control inputs are constrained to |u;| < 6000 Nm and |u| < 
5000 Nm. In the previous two exercises, we designed four different sliding mode 
control laws, given by 


= ET sat(s/e) 

—M sat(s/e) + Ĉå +ô + MG, — MAé 
-Be(sle) — 

= -Be(s[e) - C(d. — Ae) + à + Mä- — MAé 


il 


eoe R 
il 


For convenience, we take 2 to be constant. 


(a) Using simulation, choose the design parameters A, f, and € for each of the 
four controllers. Include limiters in your simulation to impose the control 
constraints. 


(b) Compare the performance of the four controllers when, due to an unknown 
load, the actual system parameters are perturbed to 


a, = 259.7, a2 = 58.19, ag = 157.19, a4 = 56.25, bı = 1030.1, 62 = 551.8125 


(c) Suppose we only measure the angles q) and go. Design a high-gain observer 
to implement the state feedback controllers. Using simulation, compare the 
performance of the output and state feedback controllers, for any one of the 
four control laws. 


14.55 Reconsider the two-link robot of the previous exercise. 


(a) Following Example 14.16, desigu a passivity-based controller to regulate the 
angles (q1, q2) from (0,0) to (1/2, 7/2): Use simulation to choose the design 
parameters K, and K4 and compare with the sliding mode controllers of the 
previous exercise. 


(b) Suppose we only measure the angles q; and qz. Design a high-gain observer 
to implement the state feedback controller. Using simulation, compare the 
performance of the output and state feedback controllers. 


14.56 Consider the TORA system of Exercise 1.16. In this exercise, we design a 
passivity-based control law [146] to globally stabilize the origin. 


(a) Using the sum of the potential energy (1/ 2)kz? and kinetic energy (1/2)v7 D(6)v, 
where v = (8, d]. as the storage function, show that the system with input 
u and output @ is passive. Is it zero-state observable? 
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(b) Let u = —ġ1 (0) + w where ġ is locally Lipschitz, $1(0) = 0, ydi(y) > 0 for all 
y #0, and limi os Jo $1(A) dà = oo. Using 
2l ing zd 
V= 2" D(0)v + Paz +f ilà) dà, v= | be 
as the storage function, show that the system with input w and output 6 is 
passive. Show also that it is zero-state observable. 


(c) Let ¢2 be any locally Lipschitz function such that ¢2(0) = 0 and yde(y) > 0 


for all y 4 0. Show that u = —$1(0) — $2(0) globally stabilizes the origin. 


(d) Let M = 1.3608 Kg, m = 0.096 Kg, L = 0.0592 m, J = 0.0002175 Kg/m?, and 
k = 186.3 N/m. Verify that 


u = —U, sat(K,8) — U, sat(K,0) 


will be globally stabilizing for any positive constants Up, U,, Kp, and Ky. 
Choose Up and U, such that Up + U, < 0.1 to guarantee that u satisfies 
the constraint |u| < 0.1. We want to design these four positive constants to 
reduce the settling time. We will use simulation and local analysis to clioose 
the constants. By linearizing the closed-loop system about the origin, show 
that the closed-loop characteristic equation is given by 


(980-8) _ 
l4 f ss? + Ba) =0 
where 
By = UE + M) a = Uke op k _ kU +mL*) 
e ^o HELS UK TS nae UNS 


and Ao — A(0). Verify that the characteristic polynomial is Hurwitz and 
construct the root locus as ĝo varies from zero to infinity. 


(e) By simulating the closed-loop system with the initial states 0(0) = x, &(0) — 0, 
zQ(0) = 0.025, and że(0) = 0, and by using the root locus analysis of part (d), 


choose the constants Up, Uv, Kp, and K, to make the settling time as small. 


as you can. You should be able to achieve a settling time of about 30 sec. 


(f) Suppose now that we can only measure 0. Using Exercise 14.48, show that the 
origin is globally stabilized by the output feedback controller 


u = —U, sat(K,0) — U, sat(K,z) 


where z is the output of the transfer function s/(¢s-+1) driven by 0 and € is any 
positive constant. By viewing this transfer function as the transfer function 


- a eeu 8 
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of a reduced-order high-gain observer, use the analysis of Section 14.5 to show 
that the output feedback controller recovers the performance of the state 
feedback controller as € tends to zero. Simulate the closed-loop system for 
different values of e and compare with the performance under state feedback. 


14.57 Consider the TORA system of Exercise 1.16. In this exercise, we design a 
sliding mode controller? to stabilize the origin. 


(a) Show that the change of variables 


s 


mLsinó z 4 mLbcosd 
mM! PTT mM’ 


transforms the system into the regular form (14.4)-(14.5). 
(b) Using 


M = Te + n = 6, £26 


L 
Vo(n) 2mL "mM 


with positive constants kı and ke, show that 


2 2 
E (m+ My ( sina) P (m+M)?ki a k23 


2kmL 12 T 973 


def mL n 
wo =n) E k (n CmeM 2j COS 1]3 — kang 


globally stabilizes the origin of 
H=, = —€— (n = ig tnt) vo me =F 
; m+M m+M 
Verify that the sliding surface can be taken as 
s = 6+ k29 — ky x, cos 8 =0 
and note that s is independent of the system parameters. 


(c) Choose A(x) such that u = —f(x) sat(s/u) globally stabilizes the origin for 
sufficiently small p. 


(d) The expression of f(x) in the previous part could be complicated. To simplify 
the control law, we take @ as a positive constant and write the control law as 


mcos curd 
A 


where the positive constants kj, k2, B and x are the design parameters. Show 
that, for sufficiently small x, this control law stabilizes the origin and guaran- 
tees that the region of attraction includes a compact set around the origin. 


35The design uses ideas from the passivity-based design of [172]. 
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(e) Let the system parameters be as in part (d) of exercise 14.56. We will use 
simulation and local analysis to choose the design parameters to reduce the 
settling time. By linearizing the closed-loop system about the origin, show 
that the closed-loop characteristic equation is given by 


3 2 
iat +718 + 729+ 33 - 


s?(s? + 4) s 
where & M) m 
m+ m 1 
= ————— S5 k ———— => 
1 = uA ^? ^ 2+ FM Y2 miM 


kka _ k(I+mL?) , 
mM MT UA. Ae A() 


= 


Verify that the characteristic polynomial is Hurwitz and construct the root 
locus as yọ varies from zero to infinity. Compare the root locus with the 


(f) By simulating the closed-loop system with the initial states 0(0) = v, 6(0) = 0, 
Te(0) = 0.025, and £.(0) = 0, and by using the root locus analysis of part (e), 
choose the constants kı, k2, B, and u to make the settling time as small as you 


can. You should be able to achieve a settling time of about 4 sec. Compare 
with exercise 14.56, 


(g) Suppose now that we can only measure ĝ and zp. Using the analysis of Sec- 


tion 14.5, show that, for sufficiently small and E, the origin is stabilized by 
the output feedback controller 


i -B sat ( + k90 m =) 


where z is the output of the transfer function s/(€s + 1) driven by @, which 
corresponds to a reduced-order high-gain observer. Verify that the output 
feedback controller recovers the performance of the state feedback coutrollor 
as € tends to zero, Simulate the closed-loop system for different values of € 
and compare with the performance under state feedback; 


Appendix A 


Mathematical Review 
\ 


Euclidean Space l 

ll n-dimensional vectors z'— [z,,...,z4]7, where z1,...,z4 are 
LE E the n-dimensional Euclidean space denoted n m id 
dimensional Euclidean space consists of all real numbers and is an E 2 ve 
Vectors in R” can be added by adding their corresponding Pues s. a Si 
be multiplied by a scalar by multiplying each component by the scalar. 
product of two vectors z and y is zly = ya) Uy 


Vector and Matrix Norms 
The norm |[z|| of a vector z is a real-valued function with the properties 
e |iz|| > 0 for all z € R^, with ||z|| = 0 if and only if z = 0. 
© lz * vl S lizi Mull, for all z, y € R^. 
o [loa] = lal liz] for all œ € R and z € R”. 


The second property is the triangle inequality. We consider the class of p-norms, 
defined by " 
lele = (xil +--+ |en) P, 1€p«o 


and 
lzlloo = mae li 


The three most commonly used norins are ||z|\1, ||z]», and the Euclidean norm 
1/2 TAM? 
æla = (iP +--+ + les) = (272) 
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All p-norms are equivalent in the sense that ‘if |: lla aud || - ls are two different 
p-norms, then there exist positive constants ci and c3 such that 


eilzlla < lzlla < eallzlle 
for all z € R^. For the 1-, 2-, and oo-norms, these inequalities take the form 
zle < lelh < vn lille, zlo € llzla < vn lello Izl S el: S llzllco 
An important result concerning p-norms is the Hólder inequality 


T ‘ = 
£ < Ile "S +-=1 


for all r € R”, y € R”. Quite often when we use norms, we only use properties 
deduced from the three basic properties satisfied by any norm. In those cases, the 
subscript p is dropped, indicating that the norm can be any p-norm. 

An m x n matrix A of real elements defines a linear mapping y = Az from R” 
into R^. The induced p-norm of A is defined by! 


|Az|lp 
All, = sup ——# = max ||Az|| 
|l ll d |l [lp ar i pP 


which for p = 1, 2, and œ% is given by 
m 1/2 n 
[Alls = max 3 layl, lla = [Amex(A7A)]"", and [Als = max lev! 
i i=l : j=l 


where \max(A7A) is the maximum eigenvalue of ATA. Some useful properties of 
induced matrix norms for real matrices A and B of dimensions m x n and n x £, 


respectively, are as follows: 
l -L Ali «Alb < v IA 
un Allee € Alla € vm [Aloo m lAl € Alla S vn lll 


lAl < VIA [Allo (ABllp < lAl Ble 


Topological Concepts in R” 
Convergence of Sequences: A sequence of vectors zo, 71, <» Tk +++ in E^, 
denoted by {xx}, is said to converge to a limit vector z if 
[zi — x]|j — 0 as k — oo 
which is equivalent to saying that, given any € > 0, there is an integer N such that 


rk- all <e VEEN | 


pa 


!sup denotes supremum, the least upper bound; inf denotes infimum, the greatest lower bound. 
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The syinbol "V' reads “for all.” A vector x is an accumulation point of a sequence 
{zx} if there is a subsequence of {zp} that converges to z; that is, if there is an 
infinite subset X of the nonnegative integers such that {t,}xex converges to z. 
A bounded sequence {zk} in R” has at least one accumulation point in R^. A 
sequence of real numbers {rx} is said to be increasing (monotonically increasing 
or nondecreasing) if rk € regi V k. If ry < re41, it is said to be strictly increas- 
ing. Decreasing (monotonically decreasing or nonincreasing) and strictly decreasing 
sequences are defined similarly with ry 2 ry41. An increasing sequence of real num- 
bers that is bounded from above converges to a real number. Similarly, a decreasing 
sequence of real numbers that is bounded from below converges to a real number. 


Sets: A subset S C R” is said to be open if, for every vector z € S, one can 


find an e-neighborhood of z 
N(z,e) = (s € R" | liz — 2] < e) 


such that N(z,e) C S. A set S is closed if and only if its complement in R” is 
open. Equivalently, S is closed if and only if every convergent sequence {zp} with 
elements in S converges to a point in S. A set S is bounded if there is r > 0 such 
that |z|| <r for all z € S. A set S is compact if it is closed and bounded. A point 
p is a boundary point of a set 5 if every neighborhood of p contains at least one 
point of S and one point not belonging to S. The set of all boundary points of 5, 
denoted by 85, is called the boundary of S. A closed set contains all its boundary 
points. An open set contains none of its boundary points. The interior of a set S is 
S — 8S. An open set is equal to its interior. The closure of a set S, denoted by 5, 


- is the union of 5 and its boundary. A closed set is equal to its closure. An open set 


S is connected if every pair of points in S can be joined by an arc lying in S. A set 
S is called a region if it is the union of an open connected set with some, none, or 
all of its boundary points. If none of the boundary points are included, the region 
is called an open region or domain. A set S is conver if, for every t,y € S and 
every real number 6, 0 < 8 < 1, the point 62 + (1 — 0)y € S. If z € X C R” and 
y € Y C R”, we say that (z,y) belongs to the product set X x Y C R® x Rr. 


Continuous Functions: A function f mapping a set S; into a set S2 is denoted 
by f : Sı — S2. A function f : R” — R™ is said to be continuous at a point x if 


f(z&) — f(z) whenever z, — x. Equivalently, f is continuous at z if, given & > 0, 
there is 6 > 0 such that 


liz — yl] < ô = |f) - f()ll < e 


The symbol “=” reads “implies.” A function f is continuous on a set S if it is 
continuous at every point of S, and it is uniformly continuous on S if, given £ > 0 
there is ô > 0 (dependent only on €) such that the inequality holds for all z, y € S. 
Note that uniform continuity is defined on a set, while continuity is defined at a 
point. For uniform continuity, the same constant ó works for all points in the set. 
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Clearly, if f is uniformly continuous on a set S, then it is continuous on S. TI 
. The 


opposite statement is not true in 
site 1 general However, if S is a com 
continuity and uniform continuity on S are equivalent. The lain c ius 


(afi + a2fo)(-) = ay fy(-) + a2 f2(-) 


is conti 

H Pr Vs Sie oe Q1 Fe a2? and any two continuous functions fi and 
: » S2, 3 are any sets an : S, : j i 

then the function hofi:S,—5 $3, ia be aes rae est 


(o o fi)) = fol fi(-)) 


" Bas end oum of fı and fo. The composition of two continuous functions 
payee S. : C R” and f : S> R™, then the set of f(z) such that z € S is 
ur irap : ie d : han 2 as by f(S). If fisa continuous function 
et S, then’ is compact; hence, contin functi 
compact sets are bounded. Moreover, if fi Gece 
led. ? is real valued, that is, f : S 
ad ibus y and q in the compact set S such that f(z) <f UM [ne Ei 
: 1s a continuous function defined on a conne d n 
is connected. A function f defined o Geile tec ue oe 
} n a set S is said to be i 
a j one to one on S if 
one-to-one function on a compacte d D pe O) TES 55 = P^ is a continuous 
set 5 C R”, then f has a conti i -1 
on f(S). The composition of f and f~} is identi is P) mu, 
ui I itio ; is identity; that is, f-1(f(z)) = z, 
ee D mi s wi y piecewise continuous on an PEL pai Rif is 
interval Jo C J, f is continuous for all J i 
at a finite number of poi jio Me epea 
1 points where f may have discontinuiti i 
point of discontinuity xo, the ri ide limit Ji pie 
ight-side limit limp o f(zo+h) and th -Side limi 
limp f(zg — h) exist; that is, the function has a sue a To mE 


Differentiable functions: | i ; aod 
z if the limit nctions: A function f : R — R is seid to be differentiable at 
f'(z) = lim t9) = f(z) 
h-0 h 


a continuously differentiable function f: R” — R, the row vector ð f/Ox is defined 


by 
OF s [OF Of 
Ox [ðr "' Oz, 
The gradient vector, denoted by V f (x), is 


vi = E i 


APPENDIX A. MATHEMATICAL REVIEW 


For a continuously differentiable function f : R” — R™, the Jacobian matriz 
[Of /0x] is an mxn matrix whose element in the ith row and jth column is 0f;/8z;. 
Suppose S C R” is open, f maps S into R™, f is continuously differentiable at 
zo € S, g maps an open set containing f(S) into R*, and g is continuously differ- 
entiable at f(xo). Then the mapping h of S into R*, defined by h(x) = g(f(z)), is 
continuously differentiable at xo and its Jacobian matrix is given by the chain rule 


ah) — _ 89) — "of 
ÔT lezo Of | papery ðE 


Mean Value and Implicit Function Theorems 


rz-ro 


If z and y are two distinct points in E", then the line segment L(z, y) joining x 


and y is 
L(z,y) = {z | z—60z- (1-8), 0<0<1} 


Mean Value Theorem 


Assume that f : R” — R is continuously differentiable at each point z of an 
open set S C R”. Let x and y be two points of S such that the line segment 
L(z,y) C S. Then there exists a point z of L(z, y) such that : 


f9-59- | (q-2 


T r-z 


Implicit Function Theorem 


Assume that f : R” x R™ — R” is continuously differentiable at each point (zx, y) 
of an open set S C R” x R™. Let (zo, yo) be a point in S for which f(zo, yo) = 0 
and for which the Jacobian matrix [Of /z](xo, yo) is nonsingular. Then there exist 
neighborhoods U C R” of to and V C R™ of yo such that for each y € V the 


. equation f(z,y) = 0 has a unique solution x € U. Moreover, this solution can be 


given as z = g(y), where g is continuously differentiable at y = yo. 


The proof of these two theorems, as well as the other facts stated earlier in 
this appendix, can be found in any textbook on advanced calculus or mathematical 


analysis.” 


Gronwall-Bellman Inequality 


Lemma A.1 Let À: [a,b] — R be continuous and p : [a,b] — R be continuous and 
nonnegative. If a continuous function y : [a,b] — R satisfies ; 


y(t) < A(t) «f u(s)y(s) ds 


2See, for example, [10]. 
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fora € t € b, then on the same interval 


vo) <a + | EOLA ur) a] ds 


In particular, if A(t) = A is a constant, then 


y(t) € Aexp | [ ^09 a 


If, in addition, u(t) = p > 0 is a constant, then 
y(t) € Xexplu(t — a)] 
o 


Proof: Let z(t) = Í u(s)y(s) ds and v(t) = z(t) + A(t) — y(t) 2 0. Then, z is 
differentiable and 


à = MOE) = HAEl) + AE) - HEE) 


This is a scalar linear state equation with the state transition function 


g(t, s) = exp | Í ' u(r) e 


a= f * s(t, 8)[u(s)A(s) — n(s)v(s)] de 


Since z(a) = 0, we have 


The term : 
f $(t, 8)u(s)u(s) ds 


is nonnegative. Therefore, 


z(t) € [ exp n u(r) ar| u(s)A(s) ds 


Since y(t) € A(t) + z(t), this completes the proof in the general case. In the special 


case when A(t) = A, we have 
: T , 
SET E 


f rad | | ule) ar| ds 
Se felon 
—1+exp if u(r) ar| 


which proves the lemma when A is a constant. The proof when both A and p are 
constants follows by integration. D 


s=a 


ll 


Appendix B 


Contraction Mapping 


Consider an equation of the form z = T(z). A solution z* to this equation is said 
to be a fixed point of the mapping T', since T leaves z* invariant. A classical idea 
for finding a fixed point is the successive approximation method. We begin with 
an initial trial vector zı and compute z2 = T(z;). Continuing in this manner it- 
eratively, we compute successive vectors zy44 = T (xp). The contraction mapping 
theorem gives'sufficient conditions under which there is a fixed point z* of x = T(x) 
and the sequence {xp} converges to z*. It is a powerful analysis tool for proving 
the existence of a solution of an equation of the form z = T(x). The theorem is 
valid, not only when T' is a mapping from one Euclidean space into another, but 
also when T' is à mapping between Banach spaces. We will use the contraction 
mapping theorem in this general setting. We start by introducing Banach spaces.! 


Vector Spaces: A linear vector space X over the field R is a set of elements 
T, Y, Z, ... Called vectors such that for any two vectors z, y € 4, the sum z +y is 
defined, £ + y € X, x +y = y +z, (zt y) z = x + (y+ z), and there is a zero 
vector 0 € X such that x +0 = x for all x € X. Also for any numbers a, f € R, 
the scalar multiplication az is defined, az € X, 1-2 = x, 0: x = 0, (aB)z = a(z), 
alx +y) =ar + oy, and (a+ B)z = ax + fx, for all x, y € X. 


Normed Linear Space: A linear space X is a normed linear space if, to each 
vector z € X, there is a real-valued norm ||x|| that satisfies 


e |[z| > 0 for all z € ¥, with ||x|| = 0 if and only if z = 0. 
o liz +yli € [lel + iyl] for all z, y € X. 
e llox|| = |a| |x|] for all a € R and z € X. 


lFor a complete treatment of Banach spaces, consult any textbook on functional analysis. A 
lucid treatment can be found in [121, Chapter 2]. 
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If it is not clear from the context whether || - || is a norm on ¥ or a norm on R^, 
we will write ||- |» for the norm on &. 

Convergence: A sequence {r4} € .Y, a normed linear space, converges to 
zcai 

lz- zj| 2 0 as k— co 

Closed Set: A set S C X is closed if and only if every convergent sequence 
with elements in S has its limit in S. 

Cauchy Sequence: A sequence {r} € X is said to be a Cauchy sequence if 


Itz - tml] > 0 as k, m= 00 


Every convergent sequence is Cauchy, but not vice versa. 


Banach Space: A normed linear space A is complete if every Cauchy sequence 
in X converges to a vector in X. A complete normed linear space is a Banach space. 


Example B.1 Consider the set of all continuous functions f : [a, b] — R”, denoted 
by C[a,b]. This set forms a vector space on R. The sum z + y is defined by 
(x + y)(t) = x(t) + y(t). The scalar multiplication is defined by (az)(t) = az(t). 
The zero vector is the function that is identically zero on [a,b]. We define a norm 
by 


liz = max ll 


where the right-hand side norm is any p-norm on R”. Clearly ||z||c > 0 and is zero 
only for the zero vector. The triangle inequality follows from 


max ||z(t) + y(t)]] < max|||x(¢)]] + [ly(t)ll] S max |[x(¢)|| + max ||] 
Also, i . 
max [az(£)| = max [o] llz(£)ll = la] max ||z(¢)|| 
where all maxima are taken over [a,b]. Hence, Cfa, b], together with the norm ||: |lc, 
is a normed linear space. It is also a Banach space. To prove this claim, we need to 


show that every Cauchy sequence in C[a, b] converges to a vector in C[a, b]. Suppose 
that (zi) is a Cauchy sequence in Cía, b]. For each fixed t € [a,b], 


llzx(t) 7 z« (t) < zk -Zmilc — 0 as k, m eo 


So (z&(t)) is a Cauchy sequence in R^. But R” with any p-norm is complete because 
convergence implies componentwise convergence and R is complete. Therefore, 
there is a real vector z(t) to which the sequence converges: 2(¢) — z(t). This 
proves pointwise convergence. We prove next that the convergence is uniform in 
t € [a,b]. Given- > 0, choose N such that ||zx —2mllc < &/2 for k, m > N. Then 
for k > N ' 


zelt) -zl < e(t) — Emlt)l + lle (2) — (11 
< llre — m lc + lw (£ = a(t) 
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By choosing m sufficiently large (which may depend on 1), each term on the right- 
band side can be made smaller than €/2; so ||z«(t) — x(t)|| < £ for k > N. Hence, 
(zx) converges to x, uniformly in t € [a,b]. To complete the proof, we need to show 


that z(t) is continuous and {zx} converges to z in the norm of C[a,b]. To prove 
continuity, consider 


llz(t--5)—z(] < lz(to5) -zelt +ô) 
+ [zx ( + 8) — zi (| + ll (5) — x21 
Since (z&) converges uniformly to z, given any € > 0, we can choose k large enough 
to make both the first and third terms on the right-hand side less than ¢/3. Because 
zx. (£) is continuous, we can choose à small enough to make the second term less than 


&/3. Therefore, z(t) is continuous. The convergence of zy to z in ||: ||c is a direct 
consequence of the uniform convergence., 


Theorem B.1 (Contraction Mapping) Let S be a closed subset of a Banach 
space X and let T be a mapping that maps S into S. Suppose that 


IT(z) - Ty) < ellz- yl; Va, yes, 0s p«1 
then ` l 
e there exists a unique vector z" € S satisfying z^ — T(z*). 


e z" can be obtained by the method of successive approximation, starting from 
any arbitrary initial vector in S. o 


Proof: Select an arbitrary x, € S and define the sequence {zp} by the formula 
Z&444 = T (zy). Since T maps S into S, zę € S for all k > 1. The first step of the 
proof is to show that {zx} is Cauchy. We have 


lzeei— Fel] = |[T (te) — T(zk-i)ll 

€ plz. -srili € Pme: mu: € € pA ee ali 

It follows that 

zkr = Zell S Eker — £rtr-ill + lmeen-i — feer-2] coc inen — Tell 

« [E H o 7] Moa — nil 

kA d pt- 
s PY e le-m recul 
: i=0 


The right-hand side tends to zero as k — oo. Thus, the sequence is Cauchy. Because 
X is a Banach space, 


ry —ni'€ A as k— oo 
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Moreover, since S is closed, z' € S. We now show that z* = T(z*). For any 
zy = T(zy-1), we have : 


llz* — T(z*)ll < liz — wall + ll — T(e*)|| S liz" — sell + pler- — 2° 


By choosing k large enough, the right-hand side of the inequality can be made 
arbitrarily small. Thus, ||z" — T(z*)|| = 0; that is, z* = T(z*). It remains to show 
that z* is the unique fixed point of T in S. Suppose that z* and y* are fixed points. 
Then, 

llz* — y" = T(z") - TG?) < ellz* - ol 


Since p « 1, we have z* — y*. 


Appendix C 


Proofs 


C.1 Proof of Theorems 3.1 and 3.2 
Proof of Theorem 3.1: We start by noting that if z(t) is a solution of 
t= fta), z(to) = zo (C.1) 


* 


then, by integration, we have 
t 
x(t) = ze | f(s,2(8)) ds (C32) 
to 


Conversely, if x(t) satisfies (C.2), then x(t) satisfies (C.1). Thus, the study of exis- . 
tence and uniqueness of the solution of the differential equation (C.1) is equivalent 
to the study of existence and uniqueness of the solution of the integral equation 
(C.2). We proceed with (C.2). Viewing the right-hand side of (C.2) as a mapping 
of the continuous function z : [to,t:] — R”, and denoting it by (Pz)(t), we can 
rewrite (C.2) as 

a(t) = (Pz)(t) (C.3) 
Note that (Pz)(t) is continuous in t. A solution of (C.3) is a fixed point of the map- 
ping P that maps z into Px. Existence of a fixed point of (C.3) can be established 
by using the contraction mapping theorem. This requires defining a Banach space 
X and a closed set $ C X such that P maps S into S and is a contraction over S. 


Let 
X =Clto,to+6], with norm elle = liso 


max 
t€ [to,to--5] 


and : 
S = {z € X | |z — zolle <r} 


where r is the radius of the ball B and ô is a positive constant to be chosen. We 
will restrict the choice of 6 to satisfy ô < t1 — to so that [to, to +ô] C [to, tı]. Notice 
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that ||z(£)] denotes a norm on R”, while ||z||c denotes a norm on X. Also, B isa 
ball in R”, while 5 is a ball in A. By definition, P maps A into ¥. To show that 
it maps S into S, write 


(Pz)(t) - zo = f(s,z(s)) ds = [ies — f (8, z0) + f (s, xo)] ds 


By piecewise continuity of f, we know that f (t, zo) is bounded on [to, t1]. Let 


h= mex t, 
d Ilf (5 zo) 


Using the Lipschitz condition (3.2) and the fact that for each z € S, 
liz (t) » zol Sr, Vite [to, to+ 6] 


we obtain 


^ 


NPH -zol s f s(e.2(6))~ Fa, zo) Ms] de 


I^ 


t ; t 

[ [L\|x(s) — zol + h] ds < n (Lr +h) ds 
0 to 

(£ — to)(Lr - h) € é(Lr 4 5) 


and 


| Pz — zolle = I(Pz)(t) — zoll X (Lr + h) 


max 
t€[to,to+d] 


Hence, choosing ô € r/(Lr + h) ensures that P maps S into S. To show that P is 
a contraction mapping over S, let z and y € S and consider 


u 


I(Pz)( — (Py)(#)ll 


f [f (s, (s) — f(s, y(8))] ds 


IA 


t 
I I(s,2(s)) — f(s, (9))] ds 


IA 


t t 
] nte - wol as < f ds ie -yle 
to s to 
Therefore, 
lPz- Pyllc < Lle - vlc < ollz -yllo for ô< È 


Thus, choosing p < 1 and ô < p/L ensures that P is a contraction mapping over S. 
By the contraction mapping theorem, we can conclude that if ó is chosen to satisfy 


ô < min fa — to, fo p<1 (C.4) 


D P 
Ir+h'L 
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then (C.2) will have a unique solution in S. This is not the end of the proof, 
though, since we are interested in establishing uniqueness of tlie solution among all 
continuous functions z(t), that is, uniqueness in A. It turns out that any solution 
of (C.2) in Æ will lie in S. To see this, rote that since z(fo) = xg is inside the 
ball B, any continuous solution z(t) must lie inside B for some interval of time: 
Suppose that x(t) leaves the ball B and let.t + p be the first time x(t) intersects 
the boundary of B. Then, 
llz(to + x) — zoll = r 


On the other hand, for all t < to + p, 


t 
llz(t) - xol < : (lf (s, x(s)) — f(s, 0)|] + I| f(s, xo)|[] ds 
t. \ : I 
< f [L[z(s) ^wol|| +h] ds € ] ar» ds 
Therefore, | 
r= |lz(to +4) - zoll Sr h)u — n2 I >ô 


Hence, the solution z(t) cannot leave the set B within the time interval [to, to + ô], 
which implies that any solution in 7 lies in S. Consequently, uniqueness of the 
solution in S implies uniqueness in +’. . 

Proof of Theorem 3.2: The key point of the proof is to show that the constant 
6 of Theorem 3.1 can be made independent of the initial state zg. From (C.4), we 
see that the dependence of ó on the initial state comes through the constant A in the 
term r/(Lr + h). Since in the current case the Lipschitz condition holds globally, 
we can choose r arbitrarily large. Therefore, for any finite h, we can choose r large 
enough so that r/(Lr +h) > p/L. This reduces (C.4) to the requirement 


ô < min [t ~ to, £} forp<1 


If tı — to € p/L, we could choose ô = t1 — to and be done. Otherwise, we choose ó 
to satisfy 6 € p/ L. Now, divide [to, t1] iuto a finite number of subiutervals of length 
6 € p/ L, and apply Theorem 3.1 repeatedly.! : a 


C.2 Proof of Lemma 3.4 
The upper right-hand derivative D'*v(t) is defined by 


D*w(t) =lim sup ver) vg 
h~0+ A 


\Note that the initial state of each subinterval x1, say, will satisfy ||f(t,21)|| € hi for some 
finite hi. 
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where lim supp (the limit superior) of a sequence of real numbers {zp} is a real 
number y satisfying the following two conditions: 


e for every € > 0, there exists an integer N such that n > N implies £n < y +£; 
e given € > 0 and m > 0, there exists an integer n > m such that zn > y — €. 


The first statement means that ultimately all terms of the sequence are less than 
y t €, and the second one means that infinitely many terms are greater than y — £. 
One of the properties of lim sup? is that if zn < £n for each n = 1,2... then 
lim sup,.,,, 2a € lim sup, ,,, Zn. From this property, we see that if |v(t + h) — 
v(t)|/h € g(t, h), V h € (0, b] and lim, ,o« g(t, h) = go(t), then Dt v(t) < go(t). 

To prove lemma 3.4, consider the differential equation 


i-jf(tz)tA z(to)=uo — (C.5) 


where A is a positive constant: On any compact interval [to, t1], we conclude from 


Theorem 3.5 that for any € > 0, there is 6 > 0 such that if A < 6, then (C.5) hasa - 


unique solution z(t, À) defined on [to, 1] and 
|2(t,A) — u(t)) «e, Wet € [to, ty] (C.6) 


Claim 1: v(t) € z(t, A) for all t € [to, ti]. 
This claim can be shown by contradiction, for if it were not true, there would be 
times a,b € (to,ti] such that v(a). = z(a,A) and v(t) > 2(t,A) fora < t < b. 
Consequently, : , 
i v(t) X v(a) 2 z(t, A) S z(a, A), Vte (a, t] 


which implies 
D*v(a) 2 ż(a, à) = f(a, z(a, à)) + A > f(a, v(a)) 


which contradicts the inequality Dt u(t) < f(t, v(t)). 
Claim 2: v(t) < u(t) for all ¢ € [to, t1]. 
Again, this claim can be shown by contradiction, for if it were not true, there would 


exist a € (to, ti] such that v(a) > u(a). Taking e = [v(a) — u(a)]/2 and using (C.6), 


we obtain 

v(a) — z(a, à) = v(a) — u(a) + u(a) — z(a, À) De - 
which contradicts the statement of Claim 1. 
Thus, we have shown that v(t) € u(t) for all t € [to,t;]. Since this is true on every 
compact interval, we conclude that it holds for all ¢.> tg. If it was not the case, 
let T < oo be the first time the inequality is violated. We have v(t) € u(t) for 
all t € [to, T) and, by continuity, v(T) = u(T). Consequently, we can extend the 
inequality to the interval [T, T + A] for some A > 0, which contradicts the claim 
that T' is the first time the inequality is violated. 


See [10, Theorem 12-4]. 
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C.3 Proof of Lemma 4.1 


Since z(t) is bounded, by the Bolzano-Weierstrass theorem,? it has an accumulation 
point as t — oo; hence the positive limit set Lt is nonempty. For each y € Lt, 
there is a sequence t; with t; — oo as i — co such that z(t;) — y as i — oo. Because 
z(t;) is bounded uniformly in i, the limit y is bounded; that is, L+ is bounded. To 
show that L* is closed, let (yj) € L+ be some sequence such that y; — y as i — oo 
and prove that y € Lt, For every i, there is a sequence {t;;} with tjj — oo as 
j — oo such that z(1;;) — y; as j — oo. We will construct a particular sequence 
(ri). Given the sequences tjj, choose 72 > £12 such that ||z(72) — ys|| < 1/2; choose 
73 > tig Such that |[z(73) — ys|| < 1/3; and so on for i = 4,5,.... Of course, T; — oo 
as i — oo and |[z(7;) — gil| < 1/i for every i. Now, given e > 0, there are positive 
integers N, and N; such that 


€ : € $ 
llz(r) -yill <=, Yi>N and |y; —yl <5, Vi» Ne 
2' 


The first inequality follows from ||z(r;) — yill < 1/i and the second one from the 

limit y; — y. Thus, 
A lai) a yll < E, vi> N= max{N,, Na} 

which shows that r(T;) — y as i — oo. Hence, Lt is closed. This proves that the 

set L* is compact, because it is closed and bounded. 

To show that L* is an invariant set, let y € L* and ¢(t; y) be the solution of 
(4.1) that passes through y at t = 0; that is, ¢(0; y) = y, and show that d (t; y) € Lt, 
Vite R. There is a sequence {t;} with 4; — oo as i — oo such that z(i;) + y-as 
i oo. Write z(&;) = (ti; xo), where zo is the initial state of z(t) at t = 0. By 
uniqueness of the solution, 


lt + ti; £0) = (t lti; 20) = é(t5z(t)) 
where, for sufficiently large i, t + t; > 0. By continuity, 
Jim O(¢ + tito) = lim é(tz(6)) = (ty) 


which shows that $(t;y) € Lt. 

Finally, to show that x(t) — Lt as t — oo, use a contradiction argument. 
Suppose this is not the case; then, there is an € > 0 and a sequence {t;} with 
ti — oo as i — oo such that dist(x(t;),L+) > e. Since the sequence z(i;) is 
bounded, it contains a convergent subsequence z(t;) — qx" as i — oo. The point z* 
must belong to Lt and at the same time be at a distance e from L*, which is a 
contradiction. 


3See [10]. 
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C.4 Proof of Lemma 4.3 


Define v(s) by . 


v(s) = PN V(z) for0<s<r 


The function v(-) is continuous, positive definite, and increasing. Moreover, V(x) > 
V(I[zl]) for 0 < [iz| € r. But V(-) is not necessarily strictly increasing. Let e (s) 
be a class K function such that o1(s) S kv(s) with 0< k < 1. Then, 


V(z) 2 v(lzll) 2 ox(llll) for liz]| <r 
On the other hand, define ¢(s) by 


é(s) = sup V(x) for0<s<r 
Izisa 


The function $() is continuous, positive definite, and increasing (not necessarily 
strictly increasing). Moreover, V(x) < ó(||z]]) for llzl| € r. Let o2(s) be a class X 
function such that a2(s) > kó(s) with k > 1. Then 


V(z) < &(llzl) < oz(llzll) for æl <r 
If D = R”, the definitions of (s) and $(s) are changed to 


v(s) 2 inf V(x), ¢(s)= sup V(r, fors>0 
lxi 2s les 


The functions y and ¢ are continuous, positive definite, increasing, and 
V(llzl) S Viz) < &(llzl), vx eR" 


The functions o; and o2 can be chosen as before. If V(z) is radially unbounded, 
V(s) and (s) tend to infinity as s — oo. Hence, we can choose o, and az to belong 
to class Xa. 


C.5 Proof of Lemma 4.4 


Since a(-) is locally Lipschitz, the equation has a unique solution for every initial 
state yo 2 0. Because y(t) < 0 whenever y(t) > 0, the solution has the property 


that y(t) S yo for all t > to. Therefore, the solution is bounded and can be extended - 


for all t > to. By integration, we have 


y t 
-f E. E DR 
Vo a(z) to 


Let b be any positive number less than a, and define 


V dr 
«9 - - [ ate) 
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The function 7(y) is a strictly decreasing differentiable function on (0, a). Moreover, : 
limyo7(y) = oo. This limit follows from two facts. First, the solution of the 
differential equation y(t) — 0 as t — oo, since y(t) < 0 whenever y(t) > 0. Second, 
the limit y(t) — 0 can happen only asymptotically as t — oo; it cannot happen 
in finite time due to the uniqueness of the solution. Let c = — limy,4 n(y) (c may 
be oo). The range of the function 7 is (—c,00). Since 7 is strictly decreasing, its 
inverse 7^! is defined on (—c,oo). For any yo > 0, the solution y(t) satisfies 


n(y(t)) — n(yo) = t — to 


Hence, 
u(t) = n^! (n(yo) + t — to) 


On the other hand, if yo = 0, then y(t) = 0, because y = 0 is an equilibrium point. 
Define a function o(r,s) by 


e(rs) = { pu m : 2 s 


Then, y(t) = c(yo, t — to) for all t > ty and yo > 0. The function c is continuous, 
since both 7 and 77! are continuous iu their domains and limz_...77!(z) = 0. It 
is strictly increasing in r for each fixed s because 


(a(r, s)) 


a a 
& 09-7 at) 20 


aud strictly decreasing in s for each fixed r because 


den s)= PE «0 


Furthermore, o(r,s) — 0 as s — co. Thus, ø is a class KL function. 


C.6 Proof of Lemma 4.5 
Uniform Stability: Suppose there is a class K function a such that 
llz(£) < o(liz(£o)]), V t2 to 2 0, V lix(to)l < c 
Given e > 0, let d= min{c,a~1(e)}. Then, for ||a(to)|| < 6, we have 
lc (£l < e(liz(to)ll) < a(5) < a(a7*(e)) = € 
Now assume that given £ > 0, there is ô = ó(£) > 0 such that 


llz(to)|] < 6 = lx(0 «e, Vt> to 
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For a fixed e, let (e) be the supremum of all applicable 6(e). The function ó(s) 
is positive and nondecreasing, but not necessarily continuous. We choose a class 
K function Q(r) such that Q(r) € kó(r), with 0 < k < 1. Let alr} = C!(r). 
Then, a(r) is class K. Let c = lim, ((r). Given z(to), with llz(£o)]| < c, let 


e = o(llz(to) |). Then, llz(to)]] < &(s) and 
le (ll < € = eliz(to)ll) (e) 


Uniform Asymptotic Stability: Suppose there is a class KEL function (r,s) 
such that (4.20) is satisfied. Then, 


lell < liz (to), 0) 


which implies that z = 0 is uniformly stable. Moreover, for |[z(to)|| < c; the solution 


satisfies 
llz(2)l < B(e t — to) 


which shows that z(t) — 0 as t — oo, uniformly in to. Suppose now that z = 0 is 
uniformly stable and z(t) — 0 as t — oo, uniformly in to, and show that there is 
a class KL function (r,s) for which (4.20) is satisfied. Due to uniform stability, 
there is a constant c > 0 and a class X function a such that for any r € (0, c], the 


solution z(t) satisfies 
liz Il < o(llz(to)l) < alr), V£2to. V lz(to)l « v (C.8) 
Moreover, given 7 > 0, there exists T = T(y,r) > 0 (dependent on 7 and r, but 
independent of to) such that 
lel <n, Vt2 to+T(n,7) 


Let T(n,r) be the infimum of all applicable T(n,7). The function T (n, r) is nonneg- 
ative and nonincreasing in 7, nondecreasing in r, and T(n,r) = 0 for all n > e(r). 


Let . 
SRM Tun T 
W.(me-]| T(srdsc-2zT(mr)-- 
n Jaja | n n 

The function W;(n) is positive and has the following properties: 


e for each fixed r, W,(n) is continuous, strictly decreasing, and W,(n) — 0 as 
7] — oo, and i 


e for each fixed n, W, (n) is strictly increasing in r. 


Take U, = Wr 1. Then, U, inherits the foregoing two properties of W, and 
T(U-(s),r) < W,(U,(s)) = s. Therefore, 


zl < Ult t5), Vt tor Y [la(toll <r (c9) 


E HM IO: 


a, Sat d 
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From (C.8) and (C.9), it is clear that 


ætli € V/o(liz(to)ll)Us(t — to), V t2 to, V I|z(to)|| < c 
Thus, inequality (4.20) is satisfied with (r,s) = Va(r)Uc(s). 


Global Uniform Asymptotic Stability: If (4.20) holds for all z(tg) € RP, 
then it can be easily seen, as in the previous case, that the origin is globally uni- 
formly asymptotically stable. To prove the opposite direction, notice that in the 
current case the function 6(¢) has the additional property (e) — co as € — oo. 
Consequently, the class X function a can be chosen to belong to class Keo, and 
inequality (C.7) holds for all z(to) € R^. Moreover, inequality (C.9) holds for any 
r 2 0. Let 


(r,s) = min [sm P m vo) 


Then, 
leli S vlis(to)l t — to); Vez to, V z(to) e R” 


If p would be class KL, we would be done. This may not be the case, so we define 
the function 
T 


r4-1 E 
"y T,8)z- À dà + L————— 
aros [Wa A+ erg 
which is positive and has the following properties: 
e for each fixed s > 0, (r,s) is continuous and strictly increasing in r, 


e for each fixed r > 0, (r,s) is strictly decreasing in s and tends to zero as 
S — oo, and 


© (r,s) 2 (ns). 


Thus, 
liz] € é(lix(to)] t — to), Vt> to, V z(to) e R^ (C.10) 


From (C.10) and the global version of (C.7), we see that 


Iz (t) € ve(lz(to)ll)e(liz(to)ll t —to), Vtz to, V x(to) e R^ 


Thus, the inequality (4.20) is satisfied globally with (r,s) = V/o(r)ó(r, s). 


C.7 Proof of Theorem 4.16 


The construction of a Lyapunov function is accomplished by using a lemma, known 
as Massera's lemma. We start by stating and proving Massera's lemma. 
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Lemma C.1 Letg: [0, 00) + R be a positive, continuous, strictly decreasing func- 


tion with g(t) + 0 ast — oo. Leth: (0,00) + R be a positive, continuous, ` 


nondecreasing function. Then, there exists a function G(t) such that 
¢ G(t) and its derivative G'(t) are class K functions defined for all t > 0. 
e For any continuous function u(t) that satisfies 0 < u(t) < g(t) for allt » 0, 
there exist positive constants ky and kz, independent of u, such that 


[ 69) 4 «n; [| eon at < is 
0 | 0 


© 


Proof of Lemma C.1: Since g(t) is strictly decreasing, we can choose a sequence 
tn such that 


1 
g(tn) € nal’ n=1,2,... 


We use this sequence to define a function n(t) as follows: | 
(a) (ta) = 1/n. 
(b) Between t, and tn+1, 7(t) is linear. 


(c) In the interval 0 < t < ty, n(t) = (t1/t)?, where p is a positive integer chosen 
so large that the derivative r/ (t) has a positive jump at t1, 7 (65) <n (tt) 


The function (t) is strictly decreasing, and for t > tı, we have g(t) « n(t). As 
t — 0*, n(t) grows unbounded. The inverse of n(t), denoted by n7! (s), is a strictly 
decreasing function that grows unbounded as s — 0*. Obviously, 

n (ule) 2 07 (9() > m7 (0) = t, VED ty 


for any nonnegative function u(t) € g(t). Define 


exp[-7^!(s)] 
H(s) = —————À. 5 
(9) 7 713) 
Since 7^! is continuous and h is positive, H(s) is continuous on 0 < s < oo, while 


1^ !(s) + oo as s — 0*. Hence, H (8) defines a class K function on [0, 00). It follows 
that the integral 


20 


G(r) = [x ds 


exists and both G(r) and G'(r) = H(r) are class K functions on [0, oo). Now, let 
u(t) be a continuous nonnegative function such that u(t) < g(t). We have 
G'(u(t)) = SPET] et 


hu) ^A VE 24 
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Thus, 


T G'(u(t))h(t) dt < i? et<1 


ti 


and = A 
J G'(u(t))h(t) dt < i G'(g(t))h(t) dt +1 < ke 
0 0 


which shows that the second integral in the lemma is bounded. For the first integral, 
we have 


= œ pul exp[-n-1(s)] œ nt) exp[—n-1(s)] d 
1 G(u(t)) a= [ n hin") ds di € 1 n — M0 ds dt 


For 0 € s € n(t), we have 
=n} (s) < -t 


Hence, 


"(5 ex EO) MO gat T et et 
i : h(0) à Ji "h(0) dm no) s A(0) 


for t > tı. Consequently, 


oo pat 


i [ouw dt < I G(g(t)) dt + i im 45^ 


Therefore, the first integral of the lemma is bounded. The proof of the lemma : 
complete. 


To prove the theorem, let 
v(&z)- [ Getrit ao) ar 
t 


where. ¢(7;t, x) is the solution that starts at (£,z) and G is a class X function to 
be selected using Lemma C.1. To see how to choose G, let us start by checking the 
upper bound on 


av T i oF 

L—- G v4. dr 
We saw in the proof of Theorem 4.14 that the assumption ||8f/8z||]; € L, uniformly 
in t, implies that ||óz(r;&, z)|| S exp[L(r — t)]. Therefore, 


oV 
Ox 


a G"'(||d(r; t, z)]|2) exp[L(r — t)] dr 


2 


A 


f ” G'UBlzllo, 7 — ) exp[L(r — 2)] dr 
< | " G'((lilla, s) exp(Ls) ds 
0 


DESEVILÍA. ` 
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With (ro, s) and exp(Ls).as the functions g and h of Lemma C.1, we take G as 
the class K function provided by the lemma. Hence, the integral 


* e def - 
] las) exeo) ds € ael) 
0 
is bounded for all ||r||]; < ro, uniformly in x. Moreover, it is a continuous and 
strictly increasing function of ||z|2, because £(||z||2, s) is a class X function in |||; 


for every fixed s. Thus, o4 is a class K function, which proves the last inequality in 
the theorem statement. Consider now 


[ tecto e 
[ Gies. dr = [^ leles) ds E ost) 
t 0 


V(t,z) 


I^ 


By Lemma C.1, the last integral is bounded for all ||z|| € ro. The function a2 
is a class K function. Recall from the proof of Theorem 4.14 that the assumption 
ll2f/8x||; < L, uniformly in t, implies that ||¢(7;t,2x)|l2 > ||zll2exp[—L(r - t)]. 
Therefore, 


V(t,z) 


IV 


oo oo 
[ethene yer» [odes ds 
t 0 
(In2)/L In2 
> | cQlela ds = "edle * allel) 
Clearly, a; (||z||2) is a class X function. Hence, V satisfies the inequality 


ea (Iizliz) S V(tz) < az(llzll2) 


for all ||; € ro. Finally, the derivative of V along the trajectories of the system 
is given by 

aV | 80V 

at p (62) = 


~ G(llzllz) «f G'(Ilella) ,— —[és(r;t 2) + palT: t, 2)f (6 2)] dr 
t lllz 
Since 
A(T: t T) + $2(7t,z)f(t,z)=0, Vr>t 
we have 


a+ 2 ft, 2) = -Glala) 
Consequently, the three inequalities of the theorem statement are satisfied for all 
liz] < ro. Notice that, due to the equivalence of norms, we can state the inequali- 
ties in any p-norm. If the system is autonomous, the solution depends only on 7 —1; 
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that is, ¢(7;t, £) = o(7 — t; x). Therefore, 
V= f OWE- tal) dr= [^ Gdstsimo ds 


which is independent of t. 


C.8 Proof of Theorem 4.17 


For any given solution z(t) of 


t= f(z), 2(0)=20 € RA (C.11) 

the change of time variable from ¢ to 7 = IN (1+ |f (z(s))l|) ds results in the system 
dz * 1 ay def n - 

qu xpo = f(z) £(0)- zo (C.12) 


where Z(r) = x(t) with t substituted in terms of r. The origin is an asymptotically 
stable equilibrium point of (C.12), and R4 is its region of attraction. If V(z) is a 
Lyapunov function for (C.12) that satisfies 


Xy (z) < -W (x) 


for some positive definite function W (x), then 


acf)» (0+ Ise Fla) < -0 +e < -wo 

x 
because 1+ || f(z)|| > 1. Therefore, it is sufficient to construct a Lyapunov function 
for (C.12). It is easier to work with (C.12) because the property Fl] € 1 implies 
that there is no finite escape time for t < 0. For the rest of the proof, we work with 
(C.12), which we rewrite as 


£z f(z) (C.13) 
by dropping the bar from Z and using £ to denote the derivative with respect to T. 


We know from Lemma 8.1 that R4 is an open set. When R4 # R”, let F be 
the complement of R4 in R^. For every z € R4 define 


= 1 2 
etc) e max [Ilo ast 7 aa} (c4) 


if Ra 7 R” and w(z) = ||z|| if RA = R”. It is easy to verify that w(z) is positive 
definite and locally Lipschitz. Since dist(z, F) — 0 as x approaches ORA, w(x) — oo 
as z approaches G4. Moreover, for rp = (1/2)dist(0, F), we have 


inf (le — yl} 2 inf {lull - ll > int lll ro}, V fell < ro 
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Hence, 


dist(z, F) > dist(0, F) — 1dist(0, F) = 3dist(0, F), v [lal] < ro 
Therefore, w(x) = ||z]| for all |[z|| < ro. 


Lemma C.2 The solution of (C.13) satisfies 
w(x(t)) < 8(w(z(0),t, vt»0, v z(0) € RA (C.15) 


where B(r, s) is a class KL function defined for all r > 0 and s > | 
a class Koo function. i ned mus o $ 


Proof of Lemma C.2: We start by showing that for any constant r > 0, there is 
a constant b = b(r) > 0 such that the solution of (C13) with w(z(0)) < r satisfies 
w(z(t)) < b for allt > 0. Suppose to the contrary that this is not the case, then there 
is a sequence of solutions z( (t) of (C.13) and constants t; such that w(x) (0)) <r 
for i = 1,2,3,--- and w(z (t) > i fori = 1,2,3,---. Let T* be the supremum of 
all T > 0 such that z(t), for i = 1,2,3,---, are finite for all t € [0, T]; that is, 


T* = sup(T > 0 | lim sup {pax {o(2(t))} < 00} (C.16) 


We consider the cases T" < oo and T* = œ separately. When T* < co, let 7; be 

a sequence of positive constants such that for every i 2 1 the solution of (C.13) 

satisfies 
w(z(0) <i => w(z(t)) <i+1, V0 t « 25 (C.17) 


This sequence is not empty because of continuity of x(t). We can always choose 
T; such that T* > 7, > m > +++ and limi sen; = 0. Let z (1:2 (t) be the sequence: 
of all functions x(t) such that w(z(T* — 7,)) > 1. The functions oh) (t) form 
an infinite sequence. To see this fact, let J, be the set of indices i such that x) (t) 
does not belong to the sequence z?) (t). The choice of 7; implies that 


w(x (t) «2 for T* -n «t& T* o, Viel (C.18) 


If there was only a finite number of functions x(t) in the sequence z (1? (t) (C.18) 
would imply that 


lim sup { mex {u(2"(t))}} < co (C.19) 
which contradicts the definition (C.16) of T*. Thus, the sequence z(!? (1) is infinite. 
Let 2’) (t) be the sequence of all functions a (19 (t) such that (x (T* —7)) > 2. 
We can repeat the foregoing argument to show that the sequence zl? (t) is infinite. 
Proceeding in the same manner, we can construct a family of subsequences until we 
end up with a sequence z(?(t) such that 


w(zO(T*-7)2j vjea123,-., Vi- 1,2,3, (C.20) 
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Since ||z? (0)|| < w(#(0)) < r and || f(z)|| € 1, the solutions £)(t) belong to the 
compact set (|z|| € r +T} for any 0 < T < T". Thus, the sequence w(z'?(t)) 
is bounded on the interval t € [0,7], uniformly in i. We can select from the 
sequence £(? (t) a subsequence £)(t) that converges uniformly on the interval [0,7], 
0 <T < T*, toa solution z(t), defined for t € (0, T*). From (C.20) and the fact that 
lim; oo T; = 0, we conclude that lim, ,q- w(r(t)) = oo. Similarly, when T* = oo, 
the solutions z(? (t) belong to the compact set (|lz|| € r-- T) for any T > 0. Hence, 
we can select a subsequence z(? (t) that converges uniformly on the interval [0,7] 
to a solution z(t), defined for t € [0,00), with lim, so w(z(t)) = oo. Thus, we 
have shown that there is a constant T*; 0 < T* < oo, and a solution z(t) such 
that w(z(0)) € r and lim, T- w(x(t)) = oo. However, this is impossible, because 
z(0)€ Ra. Therefore, we conclude that for ahy r > 0, there is b = b(r) > 0 such 
that the solution of (C.13) with w(z(0)) < k satisfies w(z(t)) € b for allt 2 0. The 
constant b(r) can be chosen as an increasing. fuuction of r and, in view of the fact 
that the origin is stable, b(r) — 0 as r — 0. Moreover, b(r) — oo as r — oo, since 
b(r) > r. We can find a class Ko function &(r) such that b(r) € a(r) for all r > 0. 
Thus, the solution of (C.13) satisfies 


w(z(t)) € é(w(z(0)), Vt» 0, Vz(0) € Ra (C.21) 


On the other hand, given any positive constants r and 7, we can show that there is 
T 2 T(n,r) > 0 such that 


v(z(0) <r => w(z(t)) <n, Vt» T (C.22) 


If this were not the case, there would exist a sequence of solutions z(? (t) of (C.13) 
and constants 7; such that 

Jim 7i =œ, w(z?(0) <r, and w(z?(n)) > 

1— 
However, from (C.21), we see that for any positive constant 6 < ao^ !(m), every 
solution of (C.13) with w(x(r)) < 6, satisfies w(z(t)) < m for all t 2 7. Hence, 
w(z9(t)) > 6 for 0 < t < rj. Because w(z?)(t)) < alr) for all t > 0, we select from 
the sequence z?) (t) a subsequence 3 (? (t) that converges uniformly in every interval 
(0, T] with 0 < T < oo. The function z(t) = lim;—oo z(? (t) is a solution of (C.13) 
for which w(x(t)) > 6 for all t > 0. This, however, is impossible since z(0) € R4. 
Thus, T'(n,r) exists. By repeating the steps of the proof of Lemma 4.5 (the global 
uniform asymptotic stability case), we can use (C.21) and (C.22) to show that there 
is a class KL function G(r, s) with 8(r, 0) > a(r) such that (C.15) is satisfied. O 


Let ó(t;x) denote the solution of (C.13) that starts from z at t = 0. Because 
|| F(z)|| is bounded, ¢(t; x) is defined for all t € 0. Moreover, since R4 is an invariant 
set (Lemma 8.1), $(t; z) € RA for allt < 0. Define g : Ra > R by 


g(z) = inf ((o(t; z))} (C.23) 


Ivv9Vwe 
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It is clear from the definition that 
g(ó(t;z)) < g(x), Vt2 0, Vr c RA (C.24) 
a7 (w(z)) € o(z) < w(z), Vere Ra (C.25) 


The first inequality of (C.25): holds because, from (C.21), w(z) < a(w(&(t; z))), 
V t € 0. Let us show that g(x) is locally Lipschitz.for x € Ra, z #0. Equivalently, 


. we show that g(z) is Lipschitz on the compact set H = {x € RA | ci < w(x) € c2}, 


with c2 > c; > 0. Inequality (C.15) implies that 
cı < wlz) € B(u(d(t;z)),-t), Vt«0, VxeH 
Let T, satisfy 8(2c9, T1) = ci. Then, for all t € —71, 
B(2c2,T,) = & € (wlot: z)), t) < B(u(6(652)), 71) 


Hence, 
w(é(t;z)) > 2cp > 2w(r) > 2g(z), Vis -T, VzeH 
This shows that, for all x € H, the infimum defining g(x) is reached within the 
interval (—T;, 0]. Using the facts that (t; x) is Lipschitz in z on H for any compact 
time interval (Theorem 3.4) and w is locally Lipschitz on R4, we conclude that g(x) 
is Lipschitz on H. Notice that this argument does not hold for c; = 0 and that 
is why we do not show that g(x) is locally Lipschitz at z =,0. However, g(x) is 
continuous for all z € R4. This is so because g(0) = 0, g(x) < w(x) (from (C.25)), 
and w(z) is continuous. - 
Define the function V : R4 — R by 


f'(z) = sup loe Ed (C.26) 
t20 


Using (C.24) aud (C.25), it is easy to verify that 
a^! (w(z)) < g(x) € V(z) € 29(z) < 2w(z) (C.27) 


Let us show that V (z) is locally Lipschitz for z € Ra, z # 0, by showing that V (z) 
is Lipschitz on H = {x € RA | c1 € w(x) € co} with 0 < cı < c2. Using (C.15) and 
(C.25), we have 


1+ 2t 
lí 


for all z € H. Let Tz > 0 satisfy 48(co, T2) = o^! (ci). Then, for all t > Ta, 


9(O(t; x) < 2u(9(t;z)) € 28(w(z),t) € 28(c2,t) 


oldie) 5. < fo (e) < faula) < 3/4) 
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Thus, the supremum defining V (x) is reached within the interval [0, T]. By repeat- 
ing the argument, used with g(z), we can show that V (z) is Lipschitz on H. Since 
V(0) = 0, it follows from (C.27) that V(z) is continuous for all z € Ra. 

. Next, we show that V (z(t)) is decreasing along the solution of (C.13). Because 
V (z) is only locally Lipschitz, its derivative along the solution of (C.13) is calculated 
by using 


^ 


V(x) = lim sup z [P (5:2) - (2) (C.28) 
h—0* 


For z # 0, take r > w(x). From the properties of class KL functions, we can 
find a function +,(p), defined for 0 < p < co and 0 < r < co, such that for 
each fixed r, ^.(p) is continuous and decreasing in p, for each fixed P, (p) is 
increasing in r, end 48(r, Yr (#)) € a7! (p/2) for all 0 < p < co. Let ho be such that 
w((t; x) > (1/2)u(z) for all t € [0, ho] and pick A e [0, ho]. Then, 


(62) = sup [ato és) 7) = sup [o t3 
Using 
1+ 2t 
gllt + h; DE S2w(o(t--h;z) < 28(w(z),t-- h) « 2B(r,t +h) 
we see that for all t + h > ^ (w(x)), 
(61 hia) 27. < do^ (jua) < da" (o(9(62))) < 3/(9(82)) 


Hence, the supremum defining V((h;x)) is reached at some time ¢’ such that 
t' +h < o (w(z)). Therefore, 


TREE 
FCU HEU 
ae | _ h 
1+t+h (14-28 + Qh) xv) 


V(é(h; zx) 


li 


9( P(t! + h; x) 
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— 
p o—; 
od 
I 
N 
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+ 
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E£ 
B 
os 
eel 


Setting . T 
a~ (8s 
2[1 + 4. (s)]? 


when s > 0 and n,(0) = 0, it can be easily verified that Nr(s) is a class Ko function 
and 


n (83) = 


V(z) < —n«(w(z)) 


Po ere me sae nehm s epi rmm NR RR i mnm 
Y N "n a : ; : KE: 
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Since the preceding inequality holds for all r > w(x), it will hold with fs) = 
SUP;>» 7). (5); that is, V(x) < ~f(w(z)) for all z #0. Define 


B 254-1 
. n(s) -f e (s) dr 


when 8 > 0 and n(0) — 0. Then 7(s) is a continuous, 


positive definite function on 
[0, oo) and n(s) < (s). It follows that 


Ọla) < -n(w(2)), Vee Ra, 2540. (C.29) 


The function V (z) satisfies all the conditions stated in Theorem 4.17, except that 


it is not smooth. To finish the proof, we smooth out V (z) by using the next two 
lemmas, which we quote without proof. 


Lemma C.3 Let D be an open subset of R^, and suppose there are locally Lipschitz 
functions 6: D — R and g : D — R” and a continuous function  : D — R such 
that the derivative of S(x) along the trajectories of = g(x) satisfies $(z) S vy(z) 
for all z € D. Then, given any continuous functions B: D— (0,00) andv: Do 
(0,00), there is a smooth function V : D — R such that l&(z) — V(z)| < u(x) and 
V(z) € (2) -- v(z) for all z € D. o 


Proof of Lemma C.3: See [118, Theorem B.1]. 


Lemma C.4 Let D C R" be a domain that contains the origin and 6 : D + [0, oo) 
be a locally Lipschitz, positive definite function such that S(x) is smooth for z #0. 
Then, there exists a class Koo function a, smooth on (0,00), such that a) (r) 40 


as r — Ot for each i = 0,1,-++, o'(r) > 0 for allr > 0, and V(z) = o(B(z)) is 
smooth on D. 


Proof of Lemma C.4: See [118, Lemma 4.3] (with the domain restricted to D 
instead of R”). . , 

Apply Lemma C.3 with D = R4 — (0), &(z) = V(z), g(z) = fiz), p(z) = 
-"(w(z)) u(z) = (1/2)a7!(u(z)), and v(z) = (1/2)n(w(z)) to find a function 
V(z), smooth on R4 — (0), such that 


&i(w(2)) S V(z) < &s(w(z)) and V(z) < —áx(u(z)) 


where &(r) = (1/2)a7!(r) and à;(r) = 2r + (1/2)a7!(r) are class Keo functions 
and ág(r) = (1/2)n(r) is continuous and positive definite on (0,00). Now apply 
Lemma C.4 with D = R4 and @ = V to finda class Xoo function c such that 
V(z) = e(V (z)) is smooth on R4. It is easy to verify that a;(r) = e(à;(r)), i = 1,2, 
are class Xoo functions, 


as(r) = ás(r) (t) 


min c 
t€[a1(r).42(r)] 


K 
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is continuous and positive definite on [0, co), 
ei(w(z)) S V(x) € az(w(z)) 


and " 


Va) = e (V(z)) (2) < -0'(V(2))&3(w(2)) < —a5(w(2)) 


i iti 4.17. The fact that 
The function V satisfies all the conditions stated in Theorem 
iran c > 0 the set (V(z) < c} is a compact subset of R4 follows from (V(z) < 
c} € (w(z) < a1! (c)). 


C.9 Proof of Theorem 4.18 


i .9 when u = 0. There- 
The statement of this theorem reduces to that of Theorem 4. 
fore, the current proof shares some ideas and terminology with the proof of DIS 
rem 4.9. Let p = a(r). Then az(u) < p and o»(||z(to)]]) € p. Let 7 = az(u) an 
define Qi, = {x € B, | V(t,z) € n) and Q4, = {x € B. | V(t,z) € p). Then 


B, C Qen C {ar (IIzl) S n} c tesllzl) S o) = B. C D 


and l 
Qin C Rep CB CD 


The sets (1,,, and f2,,4 have the property that a solution starting in either set cannot 
leave it because V(t, x) is negative on the boundary. Since 


a»(lz(to)]) < & = x(to) € Qus 


we conclude that z(t) € €, for all ¢ > to. A solution starting in Ns, must enter 
Qen in finite time because in the set {R4 p — Nin}, V satisfies 


V(t,z) € -k«0 


where k = min{W3(z)} over the set {u < ||z|| € r}, which contains ($2, — Rin} 
The foregoing inequality implies that . 


V(t, a(t) < V (to, (to) — k(t — to) < p — R(t — to) 


which shows that V(t, z(t)) reduces to within the time interval [to, to + (p — 7) /k]. 


For a solution starting inside N: n, inequality (4.43) is satisfied for all t 2 oa oe 
On C {a1((|z||) € o2(u))- For a solution starting inside :,,, but outside Qn, 


to +T be the first time it enters 2:,,. For all t € [to, to + T] 


Y < -W4(z) € -os(llzll) € —es (o2*(V)) 3€ -a(V) 


~ 
pes 


~ 


re ww «dq € mc [On70 000g G 


\ 


— 
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where a3 and a are class K functions. The existence of a3 follows from Lemma 4.3. 
Similar to the proof of Theorem 4.9, we can show that there is a class KL function 


o such that 

V(t, a(t) < o(V (to, 2(to)),t— to), Y tE [to to + T] 
Defining A(r, s) = a7! (o (a2(r),8)), we obtain | 
| lc < Alto), t — to), V tE loto +T] 


If D = R”, ag, and consequently 8, can be chosen independent of p. If a; belongs 
to class Keo, so does o: and the bound ay 1(p) can be made arbitrarily large by 
choosing p large enough. Hence, any initial state z(to) can be included in the set 


{Izl| € a3 *(p)}- 


C.10 Proof of Theorem 5.4 


We complete the proof of Theorem 5.4 by showing that the C2 gain is equal to 
super ||G(jw)|l2. Let cı be the £2 gain and c2 = supyer ||G(jw)||2. We know 
that cj € co. Suppose cı < cz and set € = (c2 ~ c1)/3. Then, for any u € £2 
with |ule, € 1, we have ||yllz, € c2 ~ 3e. We will establish a contradiction 
by finding a signal u with ||u|z, < 1 such that |lylic, 2 c2 — 2e. It is easier 
to construct such signal if we define signals on the whole real line R. There is 
no loss of generality in doing so due to the fact (shown in Exercise 5.19) that 
the £z gain is the same whether signals are defined on [0,co) or on R. Now, 
select wo € R such that ||G(jwo)la > c2 — €. Let v € C" be the normalized 
eigenvector (v*v = 1) corresponding to the maximum eigenvalue of the Hermitian 


-matrix GT (—jwo)G(jwo). Hence, v*GT (—jwo)G(jwo)v = |G(jwo)|I2. Write v as 


v = [e16/*, ae, ... , mein ]^ 

where o; € R is such that 6; € (—7,0. Take 0 < f; < oo such that 6; = 
~2tan~!(wo/B;), with B; = oo if 6; = 0. Define the m x 1 transfer function H(s) 
by 


Bizs h-s l 
H Tz B Lal A oq 25 he a 
v) rr Byes o Bas 
with 1 replacing (£i — s)/(Bi + s) if 6; = 0. It can be easily seen that H(jwo) =v 
and HT(—jw)H(jw) = Voi 02 = v*v = 1 for all w € R. Take uj (t) as the output 
of H(s) driven by the scalar function 


1 M2 jg \ 1⁄4 " 
= E -t*/o 
z(t) = (m E Lun) (=) e cos(wot), o >0, te R 


aĝ 
‘ 


fe die ee ss S Used 
* 4c yr i 
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It can be verified that ze € Lz and |Izollc, = 14 Consequently, ug € Ly and 
\|uellc, € 1. The Fourier transform of zz (t) is given by 


1 1/2 TOÀ 2 - 
eem Koss —(w—wo)^c/4 —(w-4-wo)*c/A4 
Ze Gu) (Lug, (7) |e M E ae ] 
Let y(t) be the output of G(s) when the input is u,(t). The Fourier transform 
A yo(t) is given by Yz (jw) = G(jw)Uc (jw) = G(jw)H(jw)Z,(jw). By Parseval’s 
theorem, 


hell, = af ZECHT cac" (jG jw) jw) Ze) do 


= gi], Cien eie guy Gu) so? d 
Using | 


IZ. (ju) 1 CAN 2 [er tepeye e desee] def ew) | 


2 

> ——— 
| = 14e 80/2 9 
we obtain 


1 f? F Beg 
wel, > gy [HT (—iw)G" (~du)Giw) (ju) o) de 
-00 
By letting o — oo, one can concentrate the frequency spectrum v (w) around the 
the two frequencies w = xwo.? Hence, the right-hand side of the last inequality 


approaches 
HT (— juo)" (—juo)G (juo) H (juo) = |IG(3wo)ll 2 (e2 — €)? 


as 0 — 00. Therefore, we can choose a finite o large enough such that |lyc||zc; > c2— 
2e. This, however, contradicts the inequality ||ycl|c, € c2 — 3e. The contradiction 
shows that cj = ca. 


C.11 Proof of Lemma 6.1 


Sufficiency: Suppose the conditions of the lemma are satisfied. Since G(s) is 
Hurwitz, there exist positive constants ó and u” such that poles of all elements of 
G(s — u) have real parts less than —ó, for all u < 1". To show that G(s) is strictly 
positive real, it is sufficient to show that G(ju — u) + GT (—jw — y) is positive 


4For the purpose of this discussion, the £2-norm is defined by llzI2, = f © aT(t)z(t) dt. 
-00 
Spa (w) approaches 7[5(w — wo) +.6(w + wo)] as o — co, where 6(-) is the impulse function. 
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semidefinite f ini 
ER lte for all w € R. Let (A, B,C, D) be a minimal realization of G(s). 
G(s-u) = D t C(sI - pI - A)-!B 
= D * C(sI - A)"'(sI — A)(sI — pI — A) B 
D -* C(sI — A)?! (uI + s1 — HI — A)(sI - pI - A)-1B 
= G(s) + pN(s) (C.30) 


where 
(0 N(s) = C(sI - A)! (sI — pI - A)-3B 
Since A and (A + HI) are Hurwitz, uniformly in p, there is kg > 0 such that 


max [N(jw) + NT (— jw) Sk, VweR (C.31) 


Moreover, lim, 59 w?N (jw) exists. Hence, there exist k > 0 and wi > 0 such that 


2 ; 
W Omax [N (ju) + N* (-ju)] Sk, V iw] >a, (C.32) 
If G(oo) + GT (co) is positive definite, there is o5 > 0 such that 
Omin [G(jw) + G'(-jw) >00, VwER (C.33) 
From (C.30), (C.31), and (C.33), 
Omin [Gjw ~ u) - GT(—ju ~ u)] > oo- uko, Wwe R 
uade. x PRU RI ensures that G( jw — u) + GT (—jw — u) is positive definite for 
ved : (o9) t GT (oc) is singular, the third condition of the lemma ensures 
ds G lad. has q singular values with lim... ci(w) > 0 and (p — q) 
ues with lim o c; = i 2o; 
io E id o) 0 and lim, es w e 2 0. "Therefore, there 
2 ; 
U^ C min [G(jw) + G7 (-ju)] 201, Y |w] > wz (C.34) 
From (C.30), (C.32), and (C.34), 
2 ; : 
V mis |GGw — u) + G"(-ju — p)] > c, — uk, Y l| > ws (C.35) 
where w3 = max{w,,w2}. On the compact frequency interval [7€3, v3], we have 
Amin [G(jw) + GT (—ju)] > 09 » 0 (C.36) 
Hence, from (C.30), (C.31), and (C.36), 


C min [Gijw ai Hu) t GT (-jw - u)] 2 05 — uko, y lw] <w. (C.37) 
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Choosing u < min{o1/k,,02/ko} ensures that G(jw — u) - GT (—jw — p) is positive 
definite for all w € R. 


Necessity: Suppose G(s) is strictly positive real. There exists u > 0 such that 
G(s — u) is positive real. It follows that G(s) is Hurwitz and positive real. Conse- 


quently, i 
G(jw) + G"(-ju) 20, V wER 


Therefore, i 
G(oo) + GT (oo) > 0 


Let (A, B, C, D) be a minimal realization of G(s). By Lemma 6.3, there exist P, 
L, W, and e that satisfy (6.14) through (6.16). Let &(s) = (sf — A)71. We have 


G(s) + GT (~s) = D+ DT, + Cà(s)B + B'aT(-s)CT 
Substitute for C by using (6.15) and for D + DT by using (6.16). Then, 


G(s) +G?(-s) = WTW + (BTP 4 WTL)8(s)B + B'&7(-s(PB 4 LTW) 
WTW + WT Lé(s)B + B'&T(-s)LTW 
+ Br&T(—s)[- ATP — PA]®(s)B 


ji 


Using (6.14) yields 
G(s) + GT(-8) = [wT + Be" (-s)L7] [Ww + L&(s)B) + eB? 67 (—s)P&(s)B 


From the last equation, it can be séen that G(jw) + GT (—jw) is positive definite 
for all w € R, for if it were singular at some frequency w, there would exist z € C?, 
x # 0, such that 


(z*)"(G(ju) + GT (-ju)|z =0 = (a7)! BTS? (—jw) PO(jw) Ba =0 = Br=0 


Also, 
(z*)7IG(jw) + G7 (—jw)]a = 0 => (z*)" [W + L&(-jw)B]" [W + LO(jw) Bl x = 0 


Since Bz = 0, the preceding equation implies that Wa = 0. Hence, 
(z*)T(G(s) +G7(-s)|z 8 0, V s 


which contradicts the assumption that det[G(s) + GT (—s)) is not identically zero. 
Now if G(oo) + GT (oo) is positive definite, we are done, Otherwise, let M be any 
p X (p — q) full rank matrix such that MT(D + DT)M = MTWTWM = 0. Then, 


WM =0 and . 
MT(G(ju) + GT (—jw)|M = MT BTaT(-ju)(LT L + eP)®(jw)BM 


X 


CC € 4€ € 44 C440 IP repa spia 
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We note that BM must have full column rank; otherwise, there is z # 9 such that 
BMz = 0. Taking y = Mz yields 
y? (G(jw) + GT (-ju)ly=0, VER 
which contradicts the positive definiteness of G(jw) + G?(—ju). Now 
lim w?M?(G(jw) + G7 (-jw)|M =.M?TBT(LTL +eP)BM 
uoo 


> T . 
The fact that BM has full column rank implies that M TpT(LTL + eP)BM is 
positive definite. 


C.12 Proof of Lemma 6.2 


Pp = PT > 0, L, and W that satisfy (6.11) 
i . Suppose there exist P = PY > 0, L, n 
a Using V(z) = zT Pz as a Lyapunov function for i = "ren 
shows that the origin of t = Az is stable. Hence, A has no eigenvalues in He i 
Let &(s) = (sf — A)~*. We have 


G(s) - G' (s) - D+ DT -- C9(s)B + BT (s*)CT 
Substitute for C by using (6.12) and for D + DT by using (6.13). Then, 
WTW + (BT P -- W7L)e(s)B + BT&T(s*)(PB + LTW) 


WTW + WT Lé(s)B + BTO"(s")L7W 
4 BTOT(s")[(s + s')P — ATP - PAJ®(s)B 


G(s) + G7(s*) 


Using (6.11) yields 


G(s) + GT (8%) = [WT4 BT97 (s*)LT] [W + L&(s)B] 
+ (s+ 5*)BT 97 (s*) P&(s)B (C.38) 
which shows that for all s in Rejs] > 0, G(s) + GT (s*) 2 0. It follows ved d 2 
w for which jw is not a pole of any element of cm t Go) t G i pred 
i i the third con - 
idefinite. It remains to show that G(s) satisfies 
icd nup jwo is a pole of order m of any element of G(s). Then, a 
p-dimensional complex vector z, the values taken by (z*)7 G(s)z on a semicircu 
arc of arbitrarily small radius p, centered at juo, are 


-jm T 
("y G(s)e = (a7) Kone "eI", -3S9 S 


Therefore, 


p^ Re[(z*)7 G(s)z] ~ Rel(z" )? Koz] cos m8 + Im|(z*)7 Koz] sin mô 


MEE 
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For m > 1, this expression could have either sign, while (C.38) implies that it is 
nonnegative. Hence, m must be limited to one. For m = 1, choosing 9 near —7/2, 
0, and 7/2 shows that Im((z*)7 Koz) = 0 and Re[(z*)"Koz] > 0. Hence, Ko is 
positive semidefinite Hermitian. 


Necessity: We prove necessity first for the special case when A is Hurwitz. Then 
we extend the proof to the general case when A may have eigenvalues on the imag- 
inary axis. ; 


Special case: The proof uses a spectral factorization result, which we quote with- 
out proof. 


Lemma C.5 Let the p x p proper rational transfer function matriz U (s) be positive 
real and Hurwitz. Then, there exists an r x p proper rational Hurwitz transfer 
function matriz V(s) such that 


U(s) + UT (s) = VT (-s)V(s) (C.39) 


where r is the normal rank of U(s) + UT(—s), that is, the rank over the field of 
rational functions of s. Furthermore, rank V (s) =r for Refs] > 0. 


Proof: See [214, Theorem 2]. 

Suppose now that G(s) is positive real and Hurwitz, and recall that (A4, B,C, D) 
is a minimal realization of G(s). From Lemma C.5, there exists an r x p transfer 
function matrix V(s) such that (C.39) is satisfied. Let (F,G, H,J) be a minimal 


realization of V(s). The matrix F is Hurwitz, since V(s) is Hurwitz. It can be easily 
seen that (—FT, HT, —GT, JT) is a minimal realization of VT(—s). Therefore, 


EI ET B. FSI [tH -67 ], Js} 


is a realization of the cascade connection V^(—s)V(s). By checking controllability 
and observability and by using the property that rank V(s) = r for Re[s] > 0, it 
can be seen that this realization is minimal. Let us show the controllability test;® 


the observability test is similar. By writing 
sI-F G 
0 H(sI - F)-1G-J 


I 0 sI-F G 
H(sI —- F)7} : | -H | 
sI-F G 
ww 


S'The controllability argument uses the fact that V7 (a) has no transmission zeros at the poles 
of V(s). 
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it can be seen that 


sl-F G 


rank V(s) =r, V Re[s] 3 0. & rank | | =np +r, V Re[s] 3 0 
J 


-H 
where np is the dimension of F. Now, show controllability of (.4;, Bj 


diction. Suppose (.4,, B1) is not controllable. Then, 
and a vector w € Cnr*r 


) by contra- 
there are a complex number À 
; partitioned into np and r subvectors, such that 


(wt)’F+(w3)THTH = Alw)? (C.40) 
-hw FT = A(wj)T (C.41) 
(wi) G + (w3)THTJ = 0 (C.42) 


Equation (C.41) shows that Re[A] > 0, since F is Hurwitz, and (C.40) and (C.42) 
show that : 
M-F G 


-H J 


which contradicts the fact that rank V(s) = r for Re[s] > 0. Thus, (Aj, By) is 
controllable. 


Consider the Lyapunov equation 


[ (wy)? (w3)7HT ] | | =0 = rank V(\) <r 


KF+FTK =-HTH 


Because the pair (F, H) is observable, there is a unique positive definite solution 
K. This fact is shown in Exercise 4.22. Using the similarity transformation 


Jz o 
K I 
we obtain the following alternative minimal realization of VT(—8)V (s): 


{A2, Ba, C2, Do} = 
(us Pr |; FX [J^H«G"K -GT ], 4} 


On the other hand, (—AT,CT, —BT,DT) is a minimal realization of UT (—s). 
Therefore, 


Us| D) e [ [5 ar |} E i; [C -BT], D«pr) 


is a realization of the parallel connection U (s) + UT(—s). Since the eigenvalues 
of A are in the open left-half plane, while the eigenvalues of — A7 are in the open 
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right-half plane, it can be easily seen that this realization is minimal. Thus, due to 
(C.39), (A2, B2, C2, D2} and (Ay, B4, C4, D3} are equivalent minimal realizations of 
the same transfer function. Therefore, they have the same dimension and there is 
a nonsingular matrix T such that? 


A2 = TA3T~), By = TB3, Co = CGT}, JTJ=D+DT 
The matrix T must be a block-diagonal matrix. To see this point, partition T 


compatibly as 
T= Ti Tu | 
-| Ta T2 


Then, the matrix 712 satisfies the equation 
FTig + TipAT =0 
Premultiplying by exp(Ft) and postmultiplying by exp( A71), we obtain 


d 
0 = exp(Ft)[FTi2 + Ti AT] exp( 471) = gere OT exp(A7t)] 


Hence, exp(Ft)T12 exp( ATt) is constant for all t > 0. In particular, since exp(0) = I, 
' Ti? = exp(Ft)Ti; exp( ATt) > 0 as t — oo 


Therefore, Tiz = 0. Similarly, we can show that T5; = 0. Consequently, the matrix 
Tii is nonsingular and 


F = Ta AT, GS Ta B, JTH GT K = CT’ 
Define l 
P-STLKTa,L-HTa,W-J 
It can be easily verified that P, L, and W satisfy the equations 
PA+ATP=-LTL, PB =CT™-L™W, W7W=D+D" 


which completes the proof for the special case. . e 
General case: Suppose now that A has eigenvalues on the imaginary axis. There 
is à nonsingular matrix Q such that 


qq? -| 7 h Ji op=| P|, cQ =[ Co Cn] 


where Aq has eigenvalues on the imaginary axis and A, has eigenvalues with nega- 
tive real parts. The transfer function G(s) can be written as G(s) = Go(s) -- G«(s), 
where Go(s) = Co(sI — Ag)^! Bo has all poles on the imaginary axis, and Gn (s) = 


"See (35, Theorem 5-20}. 
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Cn(sI — An)71b_ + D has all poles in the open left-half plane. It follows that : 


the poles of Go(s) are simple and the corresponding residue matrices are positive 
semidefinite Hermitian. Due to this property, we can choose Q such that 


Ao+ Az, =0, Co= BF (C.43) 


To see this fact, notice that Go(s) can be written as 


1 c. 1 1 = 
= —_—__(F, J= iR 
Go(s) gr E re Hu F 22»! 


1 - 1 " 
Bic i 


8 — jwi s+ jui 


where Fo is positive semidefinite symmetric and R; is positive semidefinite Hermi- 
tian. If, for each term in this summation, we can find a minimal realization that 
has the property (C.43), the parallel connection will be a minimal realization of 
Go(s) that has the same property. It is sufficient to consider the terms (1/s)Fo 
and [1/(s? + w2)](Fis + Hi). If ro = rank Fo, (1/s)Fo has a minimal realiza- 
tion of dimension ro, given by (0, No, NT), where Fy = Nd No. If r; = rank Rj, 
[1/(s? + w?)](Fis + H;) has a minimal realization of dimension 2r;, given by 


ee 0 wil. em Mi aes fT T 
A | a MI B= [55 ]. Co EAM Me 


where 


1 LJ j * * 
Ma = Win +N?) Maz o: - Nz), Ri 2 (NT Ni 
It is clear that (Ai, Bi, Ci) has the property (C.43). 
Since G4 (s) is positive real and Hurwitz, from the special case treated earlier, 
there exist matrices P, = P, > 0, Ln, and W such that 


P,An+ ATP, = -LI Ln, PaBn = CT - LIW, WTW =D+DT 


It can be easily verified that 
I 0 
P-Q[j p, |% 2-09 tn JQ 


and W satisfy equations (6.11) through (6.13). 


C.13 Proof of Lemma 7.1 


We start by writing a time-domain version of the infinite-dimensional equation 
(7.20). Consider the space S of all half-wave symmetric periodic signals of funda- 
mental frequency w, which have finite energy on any finite interval. A signal y € S 
can be represented by its Fourier series 


y(t) = $^ axexp(jhwt), V^ laf? < oo 


k odd k odd 


i — — D ln eS cee mame liar i eck Aas lah, ees an nnn eka, nab sai es 
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Define a norm on S by 


wea? [po a2 y^ P 
usc EE. =2 J lol 


k odd 
With this norm, S is a Banach space. Define g,(t — T) by 


gelt — 7) = 2 (GGko) expljhu(t — 7)] + G(—jhw) exp[-jho(t- 7)" 
For odd integers m and k » 0, we have 
G(jkw) exp(jkwt), ifm=k 
= gk(t — T) exp(Jmwr) dr = ¢ G(-jkw)exp(—jkwt), if m=—k (C.44) 
0, if |m] #k 


Define the linear mapping g and the nonlinear mapping gy) on S by 


m/w 
oy = f Y) a(-7)(7) dr 


k odd; k»0 


n/w 
ovy Í 35 a(t-7w(r)) dr 


k odd; k»0 


where 
u(t) = J axexp(jhwt) and v(y(t)) = Y. cy exp(jkwt) 
k odd k odd 
Using (C.44), it can be seen that 


gy = > G(ko)ay exp(jkut) 
k odd 

gy = > G(kw)ck exp(jkwt) 
k odd 


With these definitions, the condition for existence of half-wave symmetric periodic 
oscillation can be written as 


= —gvy (C.45) 
Equation (C.45) is equivalent to (7.20). In order to separate the effect of the higher 
harmonics from that of the first harmonic, define a mapping P, by 
Piy = yi = a exp(jut) + à; exp(—jut) = 2Re[a; exp(ju:t)] 
and a mapping P, by 


Phy =yr=y-m = ME a, exp(jkwt) 
k odd; |k|z£1 
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Without loss of generality, we take a, = a/2j so that yı(t) = asinwt. Solving 
(C.45) is equivalent to solving both (C.46) and (C.47): 


yh = ~—Prod(y t ya) (C.46) 
yı —Pigb(yi + ya) (C.47) 


By evaluating the right-hand side of (C.47), it can be seen that this equation is 
equivalent to (7.35). The error term dW, defined after (7.36), satisfies 


Pigdy, — Prgb(yn + yn) = 2Re[G(jw)a, à exp(jwt)] (C.48) 


Thus, to obtain a bound on óY, we need to find a bound on yp, which we will 
find by using the contraction mapping theorem, without solving (C.46). By adding 
[Phg(8 + o)/2]yy to both sides of (C.46), we can rewrite it as 


(1 + po? 3 2) yn = —Phg [von + yn) - a Zh ^. (C49) 


Let us consider the linear mapping K = I + Phg(8 + a)/2, which appears on the 
left-hand side of (C.49). It maps S into S. Given any z € S defined by 


= D bk exp(jkwt) 
k odd 


we consider the linear equation Kx = z and seek a solution z in S. Representing z 
as 
z(t) = D dp exp(jkwt) 


k odd 
we have 
(r+ pig* z 2) z2czic D i + P+? ah) dy exp(jkwt) 
k odd; |k[x41 


f 
Hence, the linear equation Kx = z has a unique solution if 


1,272 


G(jkw)| #0 . (C.50) 


"inf 
k odd; |k|#1 


In other words, condition (C.50) guarantees that the linear mapping K has an 
inverse. This condition is always satisfied if w € Q, because the left-hand side of 
(C.50) can vanish only if p(w) = 0. Denote the inverse of K by K -1 and rewrite 
(C.49) as 


+a def 
yn = -K^ Pag [von +y) - 2 +m) = Tyr 
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where we have used the fact that P, gy: = 0. We would like to apply the contraction 


. mapping theorem to the equation y; = Tyn. Clearly, T maps S into S. We need 


to verify that T is a contraction on S. To that end, consider 


Ty® —Ty = K! Pg [yrn +y) -yrl + y) 


' where 
vri) = vy) - 235 
Let 
br(y y) -vr(yi ty) = So exexp(jkut) 
k odd; |k|#1 
Then, 
2 G(jkw) 
TyO ml = 2 | 2 
[aif = 2 N sys] P^ 
2 G(jkz) i i 
E dar um 1+ [(8 + a) /2)]G(jkw) 


i 


Due to the slope restriction on Y, we have 


Vr(yi ty) - vr(yi + yo 


priy ty) - vr(yi + y) < a je - y| 


Moreover, 
G(jkw) 


k odd; vem 1+ {( Ba) )/2]G( jko)| = 
where p(w) is defined by (7.38). Hence, . 


jo -nel as (852) pn el 


Since 


. 1 fB-a 
a5 (5 7 ) <a, Vwef 


we conclude that as long as w € 2, T is a contraction mapping. Thus, by the 
contraction mapping theorem, the equation yh = Tyn has a unique solution. Noting 
that T(—y1) = 0, we rewrite the equation yh = Ty, as 


yn — Tys - T(-91) 


aa 


Vceeeereecececeecnececeononnnne 


y 
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and conclude that 


lol «x (25) tl (e 


Il |< a[( (8 — a) )/2! rm & a[(8 ~ a) /2] - 2o (w)a 
Yall S 1 K8-o)2]»w) pw) -[(P-a)/] p-a 


which proves (7.40). To prove (7.41), consider (C.47) rewritten as 


Therefore, 


y + Pigu = Pg — ply + ya) (C.51) 


by adding Pigwy; to both sides. Taking norms on both sides of (C.51) gives 


|1 + GGu)W(a)la < |G(3w)| Gn SIE lGGu)le(u)a 


from which, we can calculate the bound 


1 1+ G(ju)W (a) 
iuis lag * a= | G(jw) 


which completes the proof of the lemma. 


S$ ov) 


C.14 Proof of Theorem 7.4 


If, in the proof.of Lemma 7.1, we had defined P, = 0 and Ph = I, then the mapping 
T would still be a contraction mapping if w € Ñ. Therefore, y = yn = 0 would be 
the unique solution of yy = Tyn. This proves that there is no half-wave symmetric 
periodic solutions with fundamental frequency w € (1. The necessity of the condition 


1 


Go) + U(a) 


€ o(w) 


shows that there would be no half-wave symmetric periodic solutions with funda- 
mental frequency w € (Y' if the corresponding error circle does not intersect the 
—W(a) locus. Thus, we are left with the third part of the theorem where we would 


like to show that for each complete intersection defining I’, there is a half-wave - 


symmetric periodic solutions with (w,a) € . The proof of this part uses a result 
from degree theory, so let us explain that result first. 

Suppose we are given a continuously differentiable function ọ : D — R”, where 
D C R” is open and bounded. Let p € R” be a point such that ¢(x) = p for some 
z inside D, but d(z) # p on the boundary OD of D. We are interested in showing 
that ¢(x) = p has a solution in D, where (x) is a perturbation of d(x). Degree 


QA ae i ed 
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theory achieves this by ensuring that no solution leaves D as $ is perturbed to à 
that is why no solutions were allowed on the boundary OD. Assume that at every 
solution z; € D of ¢(x) = p, the Jacobian matrix [86/82] is nonsingular. Define 
the degree of ¢ at p relative to D by 


daD = Y, sie zo] 


zi-ó-!(p) 


, 


Notice that if d(x) z p V x € D, the degree is zero. The two basic properties of the 
degree are as follows: 


e If d(ó, D, p) 4 0, then ¢(x) = p has at least one solution in D. 


e If n: D x [0,1] > R” is continuous and n(x, u) # 0 for all z € OD and all 
p € [0, 1], then d[n(-, x), D, p] is the same for all y € [0, 1]. 


The second property is known as the homotopic invariance of d. 
Let us get back to our problem and define 


$(w, a) = W(a) + 


on I’; ¢ is a complex variable. By taking the real and imaginary parts of ¢ as 
components of a second-order vector, we can view $ as a mapping from T' into R2. 
By assumption, the equation $(w, a) = 0 has a unique solution (w,,a,) in T. The 
Jacobian of ¢ with repect to (w, a) at (wa, @s) is given by 


| £a), V) (£5 ReG GUI), | 
0 -V^(a,) (£;Im[G Gw), 


The assumptions 


EMO] #0 geg] #0 
guarantee that the Jacobian is nonsingular. Thus, 
d(ó,T,0) = 
We are interested in showing that 
dara) AEE ahaa) a0 (C.52) 


G(ju) 


3See [26] for the proof of these properties. 
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has a solution in T. This will be the case if we can show that 
: d(À,T,0) #0 
To that end, define 
n(w, a, u) = (1 — u)é(u, a) + uw, a) = d(w, a) — nóV(u, a) 


for u € [0,1], so that ņn = ¢ at u = 0 and n = @ at u = 1. It can be verified that 


|o t | >o(w), V(w,a)eor (C.53) 


EE UN 
G(jw) 
For example, if we take the boundary a = a), then, with reference to Figure 7.20, 
the left-hand side of (C.53) is the length of the line connecting the point on the 
locus of — (a) corresponding to a = a; to the a point on the locus of 1 /G(jw) 
with uj € w € wz. By construction, the former point is outside (or on) the error 
circle centered at the latter one. Therefore, the length of the line connecting the 
two points must be greater than (or equal to) the radius of the error circle, that is, 
c (w). Using (C.53), we have 


Inw,a,n)| > leloa) ~ ul a) 
lea) + ~ p80 (w,a)| > o(w) — ne(u) 


1 
zi 


where we have used the bound (7.41). Thus, for all 0 € u < 1, the right-hand 
side of the last inequality is positive, which implies that 7(w, a, u) # 0 on OT when 
u « 1. There is no loss of generality in assuming that 7(w,a, 1) # 0 on OF, because 
equality would imply we had found a solution as required. Thus, by the homotopic 
invariance property of d, we have 


d(G,T,0) = d(4,T,0) #0 


Therefore, (C.52) has a solution in T', which concludes the proof of the theorem. 


C.15 Proof of Theorems 8.1 and 8.3 


The main element in the proofs of these two theorems is a contraction mapping 
argument, which is used almost identically in the two proofs. To avoid repetition, 
we will state and prove a lemma that captures the needed contraction mapping 
argument and then use it to prove the two theorems. The statement of the lemma 
appears to be very similar to the statement of Theorem 8.1, but it has an additional 
claim that is needed in Theorem 8.3. 


1 
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Lemma C.6 Consider the system 


Ay + f(y, z) (C.54) 
à = Bz+g(y,z) (C.55) 


‘where y € RF, z € R^, the eigenvalues of A have zero real parts, the eigenvalues 


of B have negative real parts, and f and g are twice continuously differentiable 
functions that vanish together with their first derivatives at the origin. Then, there 
exist 6 > 0 and a continuously differentiable function n(y), defined for all |y|| < 6, 


such that z = ny) is a center manifold for (C.54)-(C.55). Moreover, if ||g(y,0)|| € - 


k||yl|? for all ||y| € r, where p > 1 and r > 0, then there is c > 0 such that 
ImG)I < ella”. © 


Proof: It is more convenient to show the existence of a center manifold when 
solutions in the manifold are defined for all £ € R. A center manifold for (C.54)- 
(C.55) may; in general, be only local; that is, a solution in the manifold may be 
defined only on an interval [0,2;) C R. Therefore, the following idea is used in 
the proof: We consider & modified equation that is identical to (C.54)-(C.55) in 
the neighborhood of the origin, but that has some desired global properties which 
ensure that a solution in a center manifold will be defined for all t. We prove the 
existence of a center manifold for the modified equation. Since the two equations 
agree in the neighborhood of the origin, this proves the existence of a (local) center 
manifold for the original equation. 

Let y : RE — [0,1] be a smooth (continuously differentiable infinitely many 
times) function? with (y) = 1 when ||y|| € 1 and (y) = 0 when ||yl 2 2. For 
€ »0,define F and Gby: . .... .. . wes o. : . 


zs y P. y 
F(y,z) =f (ve (2) E Gly,z) 7 9 (wo (3) sz) 
The functions F and G are twice continuously differentiable, and they, together 


with their first partial derivatives, are globally bounded in y; that is, whenever 
\|z|| € kı, the function is bounded for all y € R*. Consider the modified system 


= Ay+Fly,2z) (C.56) 
à = Bz+Gy,z) ; (C.57) 
9 An example of such a function in the scalar {k = 1) case is (y) = 1 for |y| € 1, v(y) = 0 for 
[y| 2 2, and 
1 Ivi -1 -1 
vty) 21- cz exp ( ) exp (=) dz, for1<|y|<2 
b " 2—1 2-2 
where f 


Mua 
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We prove the existence of a center manifold for (C.56)-(C.57). Let X denote the set 
of all globally bounded, continuous functions 7 : RF + R™. With supye pe ||n(y)|| 
as a norm, X is a Banach space. For ci > 0, co > 0, and c3 > 0, let $ C X be the 
set of all continuously differential functions 7: R* + R™ such that 


Hose |22 


S) - al) 
for all z, y € RF. To show that S is closed, let 7;(y) be a convergent sequence in S 
and show that 7(y) = limioo 7;(y) belongs to S. The key step is to show that n(y) 
is continuously differentiable. The rest can be shown by contradiction. Because 
continuous differentiability can be shown component wise, we do it for a scalar 7. 
Let v be an arbitrary vector in R^, with ||v|| = 1, and p be a positive constant. By 
the mean value theorem, 


Se, < cally - zl 


(0) = 0, 510) =0, Intl Sens. 


Oni 
"(y uv)-m(y) = gy O + cate) 
On; 
nay + Ho) - m0) = FEU asuo)uv 


where 0 < a; < 1 and 0 < a; < 1. By adding and subtracting terms, we can write 
the following equation: 


Om, ON; | _ [On ni | 
| E? (y) By (uv = By (¥) = By V * oua) pv 
B 3 + aga) pv 
+ [m(y + nv) — nly + uv)] - [ni(y) — 0; 
Given e > 0, find integers ip and jo large enough that 
e 
hon Im) 7 n;G)Il < 166 


for all i > ig and j > jo, which is possible because {n;} is convergent. Using the 
preceding inequality and 


0 8 
P y) — a + 2) pv 


€ cgagp?|lull? < csu? for 2=4 or j 


it can be shown that 


e 
< 2¢3p + — 
3H Sca 


|) z aio) v 


Taking u = e/(4cs) yields 


1 
i 
i 
1 
| 
| 
4 
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| 
i 
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| 
i 
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Hence, 0n;/Oy is a Cauchy sequence in the Banach space of globally bounded, 
continuous functions from R* into R*. Consequently, it converges to a continuous 
function J(y). It follows that n(y) is differentiable and 0n/0y = J (y). 
For a given 7 € S, consider the system 
j Ay + F(y,n(y)) (C.58) 
à Bz + G(y,n(y)) (C.59) 
Due to the boundedness of n(y) and [0n/8y], the right-hand side of (C.58) is globally 
Lipschitz in y. Therefore, for every initial state yo € R*, (C.58) has a unique 
solution defined for all t. We denote this solution by y(t) = r(t; yo, 1), where 
T(0;9o,7) = yo; the solution is parameterized in the fixed function 7. Equation 
(C.59) is linear in z; therefore, its solution is given by 


z(t) = exp[B(t- 7)]2(7) 
+ f exp[B(t -AJGA — ;y(7), m), nal — rir), 0) dà 


Multiply through by exp[—- B(t — 7)], move the integral term to the other side, and 
change the integration variable from À to s = A — 7 to obtain 


a(r) = ex[-B(t- rst) 
0 
+ [ee C-Bs)G(r itr) mnn tr) m) ds 


This expression is valid for any t € R. Taking the limit t + —oo results in 


0 
2(r) = f = exp(-B3)G(r(s; y(r), n), nlr(si yl), n))) ds (C.60) 


-00 
Let us rewrite the right-hand side of (C.60) with y(T) replaced by y and denote it 
by (Pn)(y). 


0 
(Priv) =f _xr(-Ba)Glr(ein).n(a(siwsn))) ds — (C60) 


With this definition, (C.60) says that z(r) = (Pn)(y(r)) for all r. Hence, z = 
(Pn)(y) defines an invariant manifold for (C.58)-(C.59) parameterized in 7. 
Consider (C.56)-(C.57). If n(y) is a fixed point of the mapping (Pn)(y), that is, 


nly) = (Pn)(y) 
then z = n(y) is a center. manifold for (C.56)-(C.57). This fact can be seen as 
follows: First, using the properties of 7 € 5 and the fact that y = 0 is an equilibrium 


point of (C.58), it can be seen from (C.61) that 
(Pn), 
Pn)(0) =0; ——-(0)20 
(Py) =o, WELO 


10See [111, Theorem 9.1]. 
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Second, since z = (Pn)(y) is an invariant manifold for (C.58)-(C.59), (Pn)(y) 
satisfies the partial differential equation 


a; Pv + F(y,(Pn)(y))] = B(Pn)(y) dt G(y, (Pn)(y)) 


If n(y) = (Pn)(y), then clearly n(y) satisfies the same partial differential equation; 
hence, it is a center manifold for (C.56)-(C.57). It remains now to show that 
the mapping (P7) has a fixed point, which will be done by an application of the 
contraction mapping theorem. We want to show that the mapping Pr) maps S into 
itself and is a contraction mapping on S. From the definitions of F and G, there is 
a nonnegative continuous function p(e) with p(0) = 0 such that 


IF(v 2)l < eate) < oleh: [arn 


lG, 2)I| < eple); Eua < ple); | 


for all y € R* and all z € R™ with ||z| < e. Because the eigenvalues of B have 
negative real parts, there exist positive constants 6 and C such that for s € 0, 


| exp(—-Bs)l| < C exp(63) (C.64) 


Since the eigenvalues of A have zero real parts, for each a > 0, there is a positive 
constant M (o) (which may tend to co as a — 0) such that for s € R, 


|| exp(As)|| < M(a) exp(a]sl) (C.65) 


< ele) (C.62) 


OF 
By z) 


< ale) (C.63) 


dG 
3; ^ z) 


To show that Pn maps S into itself, we need to show that there are positive constants 
€1; C2, and c3 such that if (y) is continuously differentiable and satisfies 


, 22 Iny) -all < ely- 
Ino ses Bolsa [a3 - 263 | s sto - a 


for all z, y € R*, then (Pn)(y) is continuously differentiable and satisfies the saine 
inequalities. Continuous differentiability of (P7)(y) is obvious from (C.61). To 
verify the inequalities, we need to use the estimates on F and G provided by (C.62) 
and (C.63); therefore, we choose c; to satisfy 0.5¢ < c; < €. Using (C.64) and the 
estimates on G and 7, we have from (C.61), 


KPa) < E llexp(—Bs)|| ||Gl| ds < 5 C exp(Bis) ep(c) ds = fue 


The upper bound on (Pr)(y) will be less than c; for sufficiently small e. Let 
Ty (f; y, n) denote the Jacobian of 7(¢;y,7) with respect to y. It satisfies the varia- 


tional equation 
oF OF On 
E" =! 
Ses G $ (5) (2) fy: "y (0; yn) = 
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(=) z e ) (a(t; y, n), n(((t;y,))) 


with similar expressions for OF /Oz and On/Oy. Hence, for t < 0, 


Ty(ti y, n) = exp( At) - [euin t- s)] IG a) + (2) (3) rty(5; y, 7) ds 


Using (C.65) and the estimates on F and 5, we obtain 


where 


b 
IImy(5 y. ll < M(o) exp(—at) + I M (a) exp[a(s — t)](1 + cz)e(s) lIry(s; v, 0)]| ds 


Multiply through by exp(at) and apply the Gronwall-Bellman inequality to show 
that}? 


IIty(tsy, 7)l <  M(a) exp(—t) 
where y = a+ M(a)(1+ c2)p(e). Using this bound, as well as (C.64) and the esti- 


mates on G and 7, we proceed to calculate a bound on the Jacobian [O(Pr)(y)/9y]. 
From (C.61), 


au (nem (8) (8) (@)] snm 


Thus, 
0 
[e2] < n Cexp(@s)(1 + c2)p(2)M (a) exp(—7s) ds 
CQ + c2)ple)M(a) 
B-Y 


provided € and o are small enough that @ > y. This bound on the Jacobian of 
(Pn)(y) will be less than c2 for sufficiently small e. To show that the Jacobian 
[G(Po)(y)/8y] is Lipschitz with a Lipschitz constant c3, we note that the Jacobian 
matrices [8F/9y], [OF /Az], [OG/8y], and [9G/Oz] satisfy Lipschitz inequalities of 
the form 

OF OF 
dy z)- By! 


z,w) 


| < Ly - zl + liz - ull 


‘Because £ appears in the lower limit of the integral, you actually apply a version of the 
Gronwall-Bellman inequality that says: If 


y(t) S Xt) + ji u(s)u(s) ds 


y(t) € A(t) + a : A(s)u(s) exp | f u(r) ar] ds 
t t 


then 
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for all z, y € R* and z, w € B,. By working with e < e* for some e* > 0, we can 
choose the Lipschitz constant L independent of e. Moreover, we can use the same L 
for all four Jacobian matrices. Using these inequalities and the Gronwall-Bellman 
inequality, we can repeat the foregoing derivations to show that 


[my (ts 9,7) — 7, (652,m)]| € Li exp(—27¢)||y — 2|| 


for all z, y € R* and t € 0, where Ly = [(1 + cz)?L + p(&)ca] M3(o)/y. The last 
inequality can be used to show that 


2m O(Pn) CLi(2y - a) 
Bes dy PET ta) < "M(8—2,) 27T 


provided 8 — 2y > 0. Choose « and & small enough that @ — 2y > 8/2. Then, 
9(P) (Pn) 

AM M (a BE (s 
5.6) ae) 


where L4 and L3 are independent of £ and c3. Choosing c3 > Le, we can choose € 
small enough that L--p(z)Lscs < cs. Thus, we have shown that, for sufficiently 
small c; and sufficiently large c3, the mapping Py maps S into itself. To show that 
it is à contraction on S, let y; (y) and n2(y) be two functions in S. Let m(t) and 
T2(t) be the corresponding solutions of (C.58), which start at y; that is, 


m(t) = T(t y. ni), i= 1, 2 
Using tlie estimates given by (C.62) aud (C.63), it can be shown that 
IF (m2, (72)) — F(m,m(m1))|| < (1 + ez)e(e)Hra — ml + (e) eup lla — m 
ye 


< [La + p(e)Lacal|ly — z| 


IG (2, 12(72)) ~ Grim (m))ll < (1 + ez)e(e)|lra — mi || + ple) ap lin — mli 
yeRk 
From (C.58), ||ma — rı || satisfies 
0 
lra) - m) < | . M(a)exp[o(s — ¢)][o(e) sup |in — ml 
i yeR* 


+ (1+ ex)e(e)|ma(s) — m (s)ll] ds 
~M(a)p(e) sup ||n2 — m|| exp(—at) 
yeRk 


1A 


+ f x- a)expla(s - tral) = mi (9)] ds 


where we used y = a+ M (a)(1 + c2)p(e) and the fact that m, (0) = 72(0). Multiply 
through by exp(aż) and apply the Gronwall-Bellman inequality to show that 


Ira?) - m. (I < =M(a)o(e) sup |m — mall exp(—72) 
ye R* 
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Using this inequality in 
0 
(Pry) - (Pr) = f exp(~Bs) [Giro nlm) ~ Gri m0) ds 


-00 


we obtain 


. 
l(Pn2)(y) - (Pm) < EL CeP* (Y + c;)p(e)]lma(s) — m (s)| 
+ ple) ar ln - mli ] ds 


I^ 


Cp(s) sup |Im -ml E 
ye R* B 


+ [ eP*(1 + e) M (a)p()e" as 


-00 


IA 


b sup |ln2 — m |l 
yeR* 


where 
1 y-a 
b= celo 2555] 
ee ataa 
By choosing £ small enough, we can ensure that b < 1; hence, Pn is a contraction 
mapping on S. Thus, by the contraction mapping theorein, the mapping Pn has a 
fixed point in S. 


Suppose now that j[g(y, O)|| € k||y||". The function G(y,0) satisfies the same 
bound. Consider the closed subset 


Y = (ne S | |n(y)l| < callyll?} 


where c4 is a positive constant to be chosen. To complete the proof of the lemma, 
we want to show that the fixed point of the mapping P is in Y, which will be the 
case if we can show that c4 can be. chosen such that Py maps Y into itself. Using 
the estimate on G provided by (C.63), we have 


Gv, (vll < EC, O) + IG, n) — GUO) < Allyl? + ole) 


Since, in the set Y, ||m(y)l| < callyll’, 
IG, nll S [k + cap(e)]Ilyll? 


Using this estimate in (C.61) yields 


0 
IPW) < f Cexp(Bs) [k + cap(e)]lin (s: y, m)? ds 
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Because 7(t;0,7) = 0 and ||7,(t:y,7)|| € M(a)exp(—^t), it can be shown, as in 
the proof of Lemina 3.1, that 


[rs m)ll < M (o) exo(-0)livl 
for t € 0. Thus, 
Cik 4 c. Af? ( ef. 
CE t ee ye d aie 


provided & and a are small enough that 8 — py > 0. By choosing c4 large enough 
and £ small enough, we have cg < c4. Therefore, (Pr) maps Y into itself, which 
completes the proof of the lemma. D 


Il(Pn)(y) Il € 


Proof of Theorem 8.1 


` It follows from Lemma C.6 with A = A1, B = Ao, f = g1, and g = ga. 0 


Proof of Theorem 8.3 


Define u(y) = h(y)—¢(y). Using the fact that A/(h(y)) = 0 and N(ġ(y)) = O((llyll?), 
where N(h(y)) is defined by (8.11), we can show that p(y) satisfies the partial 
differential equation 


Fy GLA + N(y w(u))] - Azul) - Qv, n9) = 0 (C.66) 


where 
N (y, z2) = gi(y, ó(y) + 2) 
and 
ns $(y) + z) gx (y, oy)) +N (9) - 
- a ln (y. Oy) + 2) - (v. (y))] 


A function p(y) satisfying (C.66) is a center manifold for an equation of the form 
(C.54)-(C.55) with A = Ai, B = As, f = N, and g = Q. Furthermore, in this case, 


Q(y, 0) = N(&(y)) = O(llyll?) 


Hence, by Lemma C.6, there exists a continuously differentiable function u(y) = 
O(|y||?) that satisfies (C.66). Therefore, h(y) — é(y) = O(llyll"). The reduced 
system is given by 


Ary + gi(y, h(y)) 
= Ajyt+gily,d(y)) + n h()) - n. é() 


ý 
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Since gi is twice continuously differentiable and its first partial derivatives vanish 
at the origin, we liave 


in the neighborhood of the origin. By the mean value theorem, 


à 
S (2)| < kaliyli + all 


gly, h(y)) — gly, o(y)) = Seg, C(y))[h(y) — o(y)] 


where 
IEO) S luo] + lea) S kallyll? < kaliyli 
for |ly|| < 1. Therefore, , 


lla (ys A(y)) — 0 (s H(y))I] < Rally Ie) = Olye’) 
which completes the proof of the theorem. Hu 


C.16 Proof of Lemma 8.1 


To show that R4 is invariant, we need to show that 
z € Ra > 2(s) € f A(s; z)ce RA, VscR 


Since 
(t4(5;2)) = 4(¢ + viz) 

it is clear that lim, sS d(t;z(s)) = 0 for all s € R. Hence, Ra is invariant. To 
show that Ra is open, take any point p € Ra and show that every point in a 
neighborhood of p belongs to R4. To that end, let T > 0 be large enough that 
||@(T; p)|| < a/2, where a is chosen so small that the domain ||r|| < a is contained 
in Ra. Consider the neighborhood ||z — pl| < b of p. By continuous dependence of 
the solution on initial states, we can choose b small enough to ensure that for any 
point q in the neighborhood ||z — || <b, the solution at time T satisfies 


ler; p) - é(T19)l| < 3 


Then, 
I&(T5a)l < loi 9) — &(7ip)l + llé(Tig)l < a 


This shows that the point ¢(T;q) is inside R4. Hence, the solution starting at q 
approaches the origin as t — oo. Thus, q € RA and the set Ra is open. We leave it 
to the reader (Exercise 8.13) to show that R4 is connected. The statement about 
the boundary of R4 follows from the next lemma. 


Lemma C.7 The boundary of an open invariant set is an invariant set. Hence, it ' 


is formed of trajectories. A 


H 
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Proof: Let M be an open invariant set and z be a boundary point of M. There 
exists a sequence z, € M that converges to z. Since M is an invariant set, the 
solution d(t;z4,) € M for all t € R. The sequence ó(t; £n) converges to ¢(t;x) for 
alt € R. Thus, ¢(t;2) is an accumulation point of. M for all t. On the other 
hand, ¢(t;2) ¢ M, since z is a boundary point of M. Therefore, the solution ¢(¢; x) 
belongs to the boundary of M for all t. D 


C.17 Proof of Theorem 11.1 


We will work with the full problem given by (11.10) and (11.11) in the (z, y) vari- 
ables. The error estimate for z will then follow from the change of variables (11.9). 
Let y belong to the domain Dy, where (11.9) maps D; x Dy into Dz. When we 
analyze (11.12) with the slowly varying t and x, we want to use the uniform expo- 
nential stability property (11.15) of the boundary-layer model. Inequality (11.15) is 
valid only when z € Dz, so to use it, we need to confirm that the slowly varying x 
will always be in Dz. We anticipate that this will be true because the solution Z of 
the reduced problem (11.8) belongs to S, a compact subset of D,, and we anticipate 
that the error |[z(,€) — £(t)|| will be O(e). Then, for sufficiently small €, z will 
belong to D,. However, the estimate ||z(t, €) — z(t)|| = O(e) has not been proven 
yet, so we cannot start by using it. We use a special technique to get around this 
difficulty.!? If D, z R”, let E be the complement of D, in R” and define 


k=} inf {|z -yll |z € S, ye E) 20 
If D, — R^, take k to be any positive constant. The sets 
Si = {x € R” | dist(x, S) < k/2) | and S$,-— {x € R^ | dist(z, S) < k} 


are compact subsets of Dy and S C S1 C Ss. Let V : R” — [0,1] be a smooth 


. (continuously differentiable infinitely many times) function with y(x) = 1 when x 


belongs to Sı and y(x) = 0 when z is outside 55:13 We define F and G by 
F(t, x,y, €) F(t, plz) y + A(t, e(z)), €) (C.67) 


Glave) = ete) tlt, o(a), e) - lt ola) 


-€ 2 t, o(z))/ (t, p(x), y + A(t, (x), e) (C.68) 


where p(x) = (x — &o)i(z) + £o. It can easily seen that, for all z € R^, (z) is 
bounded and belongs to D;, since D, is convex. When z € $1, we have (z) = z; 
hence, the functions F and f are identical. The same is true for the functions G 
and g — €|(0h/0t) + (8h/0z)/]. It can be verified that for all (t,£, y,€) € [0, ty] x 
R^ x Qı x [0, £o], where N; is any compact subset of Dy, we have the following: 


12The same technique is used in the proof of the center manifold theorem. (See Appendix C.15.) 
'3The existence of V is shown in Lemma 6.2 of Chapter 23 of [111]. 
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e F and G and their first partial derivatives with respect to € are continuous 
and bounded. 


e F(t,z,y,0) has bounded first partial derivatives with respect to (z, y). 


© G(t,x,y,0) and [OG(t, z, y, 0)/8y] have bounded first partial derivatives with 
respect to (t, £, y). l 


E 


Consider the modified singular perturbation problem 


è = F(t,z,y,e),  2(to) = €(e) (C.69) 

ey G(t, 2,4, €); y(to) = n(c) I h(to, £(&)) (C.70) 

The modified problem of (C.69) and (C.70) is identical to the original problem of 
(11.10) and (11.11) when z € Si. The set Sı has been chosen in anticipation that 


the solution x(t, €) will be confined to 51, which is based on the fact that Z(t) € S. 
The boundary-layer model 


dy — 
ar =i G(t, £, y,0) (C.71) 
has an equilibrium point at y = 0. Since 

Gt, x,y, 0) = g(t, p(z), y + h(t, p(x), 0) 


for any fixed z € R^, the boundary-layer model (C.71) can be represented as a 
boundary-layer model of the form (11.14) with y(x) € D, as the frozen parameter. 
Since inequality (11.15) holds uniformly in the frozen parameter, it is clear that the 
solutions of (C.71) satisfy the same inequality for all x € R”; that is, 


liy(r)]l < kll(0)]l exp( 7), V [ly(0)Il < po, V (t,£) € [0,5] x R”, Vr 2 0 (C.72) 
The reduced problem for (C.69) and (C.70) is 
i- F(t,2, 0, 0), z(t) = £o (C.73) 


- This problem is identical to the reduced problem (11.8) whenever x € $,. Since 


(11.8) has a unique solution Z(t) defined for all t € [to, t1] and Z(t) € S, it follows 
that Z(t) is the unique solution of (C.73) for t € [to,t;]. We proceed to prove 
the theorem for the modified singular perturbation problem given by (C.69) and 
(C.70). Upon completion of this task, we will show that, for sufficiently small e, 
the solution z(t,c) of (C.69)-(C.70) belongs to Si. This will establish that the 
original and modified problems have the same solution and proves the theorem for 
the original problem given by (11.10) and (11.11). 

Consider the boundary-layer model (C.71). Since [8G/8y] has bounded first par- 
tial derivatives with respect to (t, x) and G(t,z,0,0) = 0 for all (t,x), the Jacobian 
matrices [2G/01] and [(0G/Oz] satisfy 


8G Jac 
SE] s eaters [FE] s zwi 
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Using these estimates and (C.72), we conclude from Lemma 9.8 that there is à 
Lyapunov function Vj (t, z, y) which satisfies 


allyl? < Vi (tz, y) < callyll? (C.74) 
ƏV; 
Gy 6 (623,0) < ~calll? (C.75) 


ƏV; 
sealuli |BE| < tu «alf ^— (C79) 


for all y € {Ily|| < po} and all (t,x) € [0,t;] x R”. The derivative of V, along the 
trajectories of the full system (C.69)-(C.70) is given by 


E 


E 


» 18V, 0 , ML, 
Y= T RN M ere 
kA 0Vi 
+ DE + 9 re) 


Using (C.75) and (C.76) and the estimates 
F(t Ty E) S ko: |IG( zy, 5) - G(t5 x v, 0)|| S eLs 
we obtain 


| 


I^ 


[^ 
- Sl + caZa|lull + silyl? + cekollyll 


I^ 


t^ e 2 « MN NE 
loli dall freno 


Thus, if at some time t* > to, |[y(£*.&)]| < po/e1/c2 de |, the solution y(t,€) of 
the full problem will satisfy the exponentially decaying bound 


lyt e)l] < uea exp [6 


where a = c3/4c2 and ô = 2czc4L3/c1c3. On the other hand, y(to,€) = ne) — 
h(to, £(£)) = no — h(to, £o) + O(e) and no — h(to, o) belongs to Ry, a compact subset 
of the region of attraction of the boundary-layer model 


a = G(to, £o, y,0) = g(to,fo.y + h(to, £o), 0) (C.78) 


We recall from (the converse Lyapunov) Theorem 4.17 that there is & Lyapunov 
function Vo(y) such that 


clt tes, Vt>t (C-77) 


altos £o, y hts to),0) < - Wa) 


EC 
Bes 


MM MM n te RC AAA ZA2ZAoAeY M—————————————————-R 
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over the region of attraction, where Wa(y) is positive definite and (Vo(y) € c) is a 
compact subset of tho region of attraction for any c > 0 . Choose cg such that Qy 
is in the interior of (Vo(y) € co). The derivative of Vo along the trajectories of the 
full system (C.69)-(C.70) is giveu by 


; _ 18W 
= xay nM i 


18V 18V, 
= Py Coson 0) + g [G(6 i ye) = G(tos £o, v, 0)] 


It can be verified that, for all (t,y) € [to, to + €T] x (Vo(y) € co}, 
1 a 
Vo < = [-Wo(y) + aoe(1 + T)] 


for some ag > 0. Application of Theorem 4.18 shows that there is ef > 0 such that, 
for 0 < € < ej, y(t, e) satisfies the inequality 


lly(t, £) < B(uz, (t P to)/e) + o(e(1 + T)) 
over the interval [to, to -- £T], where £ is a class KL function, o is a class K function, 
and ugis a positive constant. Choose T large enough that f(uo, T) < u/2; then 


choose &* < ej small enough that o(e*(1 + T)) < u/2. It follows that, for € < e*, 
y(t, c) satisfies | 


lly(t, e)l] € xı + #/2 for t € [to to -- T] and |ly(to + eT,e)|| < u (C.79) 


with 41 = f(u5,0). Then, (C.77) and (C.79) yield 
lul, e)l] < k exp el ETE (C.80) 


for some k; > 0. 
Consider (C.69). By rewriting the right-hand side as 


F(t,2,y,€) = F(t,z,0,0) + [F(t,2, y, £) — F(t, x, 0,0)] 


we view (C.69) as a perturbation of the reduced system (C.73). The bracketed 
perturbation term satisfies 


F(t, s.y, e) - F(t,z,0,0] < ||F(t,2,y,e) - F(t,z,y,0)|| 
i + || F(t, 2, y, 0) — F(t, z,0,0)|| 
< Leet Lsllyll 


I^ 


-a(t -t 
Pe + Og exp LM o) | 
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where 6, = L4 + L5ó and 65 = Lski. Define 
u(t,€) = z(t, e) — z(t) 


Then, 
wt) = Ele) - (0) [IFiszts uo) = Ft 2(2),00] d 
= «9-0 ['Irtsstodaineho) - Fbst] d 
+ Fist, e),0 0) — F(s, z(s),0,0)] ds 
and 


e -a(s — to) : 
lulto) < he f (net exp [=] as+ [ Lel|u(s, &)|| ds 
to € to 
05€ t 
€ ka |61e(& — to) + = +f Le||u(s, &)]| ds 
0 


By the Gronwall-Bellman lemma, we arrive at the estimate 
lx (t, e) — Z(t) | < eka[1 +t — to] exp[Le(ti - to)] (C.81) 


which proves the error estimate for z. We can also conclude that, for sufficiently 
small e, the solution x(t, e€) is defined for all t € [to, t1]. 
'To prove the error estimate for y, consider (C.70), which, for convenience, is 
written in the 7 time scale as 
dy 


d = G(to + eT, z(to + ET, £), V £) 


Let g(r) denote the solution of the boundary-layer model 


ay = G(to, £o, V; 0), y(0) =m h(to, £o) 


and set i 

v(r, e) = y(7,€) - (7) 

By differentiating both sides with respect to 7 and substituting for the derivatives 
of y and ĝ, we obtain 


d 
a - G(to + ET, Z (to Ter, €), y(7,€),€) “a G(to, £o, (7), 0) 


: We add and subtract G(to + £r, z(to + ET, €), v, 0) to obtain 


2 = GU 0 AG (C.82) 


iE oe cl ity, pie ie: elaine a mem A, ey cali Aas ine veka, meen, ett bien ays wi AD 


2 « 
um à 45 
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where t = ta teT, z = r(to +e7,¢), AG = A, + Ay + Az, and 


Ai = G(t, £, V 0) ER G(t, T, $, 0) ES Git, 2,v,0) 
A» = G(imy, £) - G(t,z,y,0) 


As = Git, T, $, 0) Du G (to, £o, $, 0) 
It can be verified that —— » 
lAl S Kalle? + ksilol ll, el] < eLs 


lAsl < Zijt- tol Hll + Lalle — Soll Ill < (Lier + Leea + Laerko)ligl 


for some nonnegative constants k4, ks, and a. Repeating the derivation that led to 
(C.80), it can be shown that 


ll&(T)) < e^", vr 20 (C.83) 


Hence, 


AG] kallo? + kski||v|| e797 + &Da + eae (1 + 7)e7 7 


ki||vl + kski||vlle ^" + eaz (C.84) 


AIA 


where a, = max{ La, Lı + Loko} and a? = L3 + ak; max(1,1/a). We have used 
the fact that (1+ 7)e~°7 < max{1,1/a}. Equation (C.82) can be viewed as a 
perturbation of 

dv 

dr 
which, by Lemma 9.8, has a Lyapunov function V;(t,z,v) that satisfies (C.74) 
through (C.76). Calculating the derivative of V, along the trajectories of (C.82) 
and using the estimate (C.84), we obtain 


ug 90V, AV; 18V, 
Y= i + o: z àv 652, v,0) + AG] 


= G(t, x, v, 0) (C.85) 


IA 


C C 
caliv| + cekollvl? — zl + Zell (allel? + ksh [|vlle" ^" + eaa) 


For ||v|| € c3/4cak4 and 0 < € < cs/4(cs + ceko), we have 


: c c4 kgk 
A s - el + SP oeer + cyano] 
2 
S = he) Vi 2k V/V 


where ka = c5/4c», ky = caksk1/2c1, and ke = c4a2/2 /c;. Taking W = V/V, yields 
. D*W(r) € - (ka — ke ^7) W + eke 
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where D+W(r) is the upper right-hand derivative of W with respect to 7. By the 
comparison principle (Lemma 3.4), we conclude that 


Wir) < 4(r,0)W(0) +e A Ieka 
0 
where | 
é(r, c) = exp |- f (ka = kye7®) a and lé(r, e)| < kge7 2s (770) 


for some kg, œg > 0. Using the fact that v(0) = O(s), we conclude that v(T) = O(e) 
for all r > 0. This completes the proof that the solution of (C.69)-(C.70) satisfies 


ft 
«2-39 =0l6), use) -9 (2) = 088) 
V t € [to, ti] for sufficiently small e. Since z(t) € S, there is e} > 0 small enough 


such that 2(t,¢) € S for all t € [to, t1] and all € < €}. Hence, z(t, €) and y(t, c) are 
the solutions of (11.10)-(11.11). From (11.9), we have 


i = 
alte) - h(t, B(t)) - 9 (:) -v(e) - $ () + h(t, z(t,€)) = h(t, 2(¢)) = O(e) 
where we have uscd the fact that A is Lipschitz in z. Finally, since (7) satisfies 
(C.83) and : 
xp [=e] <e, Vo(t — 1o) 2eln () 
the term $(t/c) will be O(e) uniformly on [à t1] if € is small enough to satisfy 
cin (2) € a(ty — to) 


The proof of Theorem 11.1 is now complete. 


C.18 Proof of Theorem 11.2 


The proof follows closely that of Theorem 11.1. We will only point out two main 
differences, one in showing that z belongs to Dz and the other in analyzing the 
error z — £. The first point makes use of the Lyapunov function V of the reduced 
system, while the second one makes use of its stability properties. 
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properties as before for all (t,2,y,€) € [0, 00) x {Wi (x) € c) x $1 x (0, €o]. Moreover, 
(AF /Oz](t, x, 0,0) is Lipschitz in x, uniformly in t. For all z € (Wi(z) < c), we can 
repeat the earlier derivation to show that y(t,€) satisfies (C.80). Hence, 


V < -Ws(z) + ke + ky exp [en 


Using the fact that £o € (Wa(x) € pc}, we can see that. there is a time T} > 0, 
independent of e, such that, for sufficiently small e, z(t,£) € (Wa(x) € c) for all 
t € [to, to + Ti]. For ¢ > to + T1, the exponential term exp [-o(t — to)/e] is O(e). 
Thus, . 

V < -Ws(x) + kee 
Using this inequality, we can show that V is negative on the boundary V(t, x) = c. 
Therefore, z(t,£) € (Wi(z) € c) for all t> to. 

To analyze the approximation erro'vu(t, e) = z(t,€) — Z(t), we view (C.69) as a 
perturbation of the reduced system (C.73). Instead of using the Gronwall-Bellman 
lemma to derive an estimate of u, we employ Lyapunov analysis that exploits the 
exponential stability of the origin of (C.73). The Lyapunov analysis is very similar 
to the boundary-layer analysis of Theorem 11.1's proof. Therefore, we will describe 
it only briefly. The error u satisfies the equation i 


ù = F(t,u,0,0) + AF (C.86) 

where 
AF = [F(t,z * u,0,0) — F(t, #, 0,0) — F(t u,0,0)] + [F (42, y.€) ^ F(t2,0,0)] 
It can be verified that 
» P E —a(t —1t $ 
[AFI < Balal + Rll la + o exp | 259] + ei 
The system (C.86) is viewed as a perturbation of 
ù = F(t,u,0,0) (C.87) 


Because the origin of (C.87) is exponentially stable, we can obtain a Lyapunov 
function V (t, u) for it by using Theorem 4.14. Using this function with (C.86), we 


.obtain 
> 0V 98V av 
V = er t au e 0:0) + S7 AF 
ias Sal span ces Lee tall] er 
S —&lull* + allel] 4 kallull* + ksllul] zl] + ke exp | — 2—— | + Ekr 


V 


Using the Lyapunov function V, we will argue that x belongs to the compact 
set (Wi(z) < c) for all t > to. Therefore, we do not need to truncate z by using the 
function v(z), as we did in the proof of Theorem 11.1. The functions F and G are 
still defined by (C.67) aud (C.68), but with (x) replaced by x. They have the same 


For |[ul| < &/264k,, we have 


$ < -2 [E herit] 42 (e PE [6] ! Ww 
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for some ka, & > 0 and he, ke, ka > 0. Applying the comparison principle yields 


W (t) < O(t, to) W(0) + dtt s) [ek + exp [=E= 2j 


to 


where W = VY and 
I(t, s)| < ke? 79, & > 0, ky » 0 


Since u(t) = O(e) and 
f exp[-6(t — s)| exp [en ds = O(e) 
to € 


we can show that W(t) = O(e) and, subsequently, u(t,¢) = O(e). The rest of the 
proof proceeds exactly as in Theorem 11.1. Notice that the boundary-layer analysis 
in that proof is valid for all 7 > 0. 


C.19 Proof of Theorem 12.1 


We analyze the closed-loop system (12.45) as a slowly varying system by using the 
results of Section 9.6. Since dependence on w does not play a role in the proof, we 
write g(¥, p, w) as g(, p). It can be verified that g(., p) is continuously differen- 
tiable in a domain Dy x Dp and %,,(a) and Aj, (a) are continuously differentiable 
in Dp. Because Ama(a) is Hurwitz for all a € Dp, it is Hurwitz uniformly in a for 
all a € S (a compact subset of Dp). Hence, Ams satisfies all the assumptions of 
Lemma 9.9 for a € S. Let Pms = Pms(a) be the solution of the Lyapunov equation 
PrsAms + AL, Pa, = —I. We use V(A5,o) = X7 Pa, as a Lyapunov function 
candidate for the frozen system A; = g(As + As (a), a). Lemma 9.9 shows that 
V(A5,a) satisfies (9.41), (9.43), and (9.44). We only need to verify (9.42). The 
frozen system can be rewritten as 3 


x; = Ams (a) Xs + Ag(A5, a) 


where 
|Ag(X5, olla = lg(&s + &ss(o), a) ^ Ams(@) sla < ETE 
in some domain {||%||2 < rı}. Thus, the derivative of V along the trajectories of 
Xs = g(Xs + Ass (a), a) satisfies 
V < -Æl + 2c ll < — 5181 


for (Xs||a < 1/(4cok1). Therefore, there exists r > 0 such that V(45,o) satis- 
fies (9.41) through (9.44) for all (25,0) € {||¥sll2 < r} x S. The conclusions of 
Theorem 12.1 follow from Theorem 9.3. 
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C.20 Proof of Theorem 12.2 


To analyze the closed-loop system (12.58)-(12.59), we combine stability analysis of 
slowly varying systems from Section 9.6 with stability analysis of singulerly per- 
turbed systems from Section 11.5. Since dependence on w does not play a role in 
the proof, we write (12.58)-(12.59) as 


Y = (X,+ NOB-A — (C.88) 
ev = —0-9(X, p) (C.89) 
When e€ = 0, we obtain the reduced system A g(X, p), which was analyzed in the 
proof of Theorem 12.1 by using the quadratic Lyapunov function AT Prats. It can 


be verified that (X, p) is continuously differentiable in a domain Dx x Dp. The 
change of variables 


Y= X — Xs (0), Z=09- G(X, p) 
transforms the system (C.88)-(C.89) into 


Os. 
P 


Y = IV+ Xalo) p) +N) - 75 


(C.90) 


eb = -Zepp + Aloo) +N] -e3 (090) 


Using V = YP Pas + (1/2)Z7Z as a Lyapunov function for (C.90)-(C.91), we 
obtain 


y = -yTy+ 2)" Pas [aw + Xap), p) — Ams(p)Y + N(p)Z — ei) 
: 
+97 Fu » 
1 ð 
- 5 Z"Z-2" (Ziv + As (p) p) + N(p)2] + ta) 
1 * 
< -IVi = IEB + eVI + eal? MZe + collllalAlls 


+ call IZ llla + csl TI + cell lla Mella 


in some neighborhood of the origin, for some positive constants cj. Limiting our 
analysis to a neighborhood where ||)|l2 € cz € 1/(4c1), we arrive at the inequality 


. 1 1 
Y s -gll- z MI + Gall?lla + cacel|V 2 + cal Z i) lll 
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Choosing £* small enough that the 2 x 2 matrix is positive definite for all 0 < & < e*, 


we end up with 
Y < -2aY + 20 V V|lellz 


for some positive constants a and B. Hence, W = VV satisfies the inequality 


D*W < -aW + Allalle 


Applying the comparison lemma concludes the proof. 


C.21 Proof of Theorem 13.1 


The proof uses the notions of Lie brackets and involutive distributions, introduced 
in Section 14.3, as well as the notion of complete integrability. A nonsingular 
distribution A on D, generated by fi, ..., fk, is completely integrable if for each 
xo € D, there exists a neighborhood N of zy and n—k real-valued smooth functions 
hi(z), ..., hax) such that 


ah ahaa 0; Vi<si<skandl<j<n-—k 


dy—k(x) are linearly independent for all z € D, 
Oh É oh | 


and the row vectors dhi(z),..., 
where 
dh(x) = — = |—,..., — 
aa re ue 
is called aay differential of h. A key result from differential geometry is Frobenius 
theorem,!4 which states that a nonsingular distribution is completely integrable if 
and only if it is involutive. 
We start by stating and proving two preliminary lemmas. 


Lemma C.8 For all x € D and all integers k and j such that k 2 0 and0 € j < 
p—k-1, we have 


online canis ia 


0, O<jtk<p-l 


Lagi hp h(a) = (C.92) 
i (7-19 LL"! h(z) + 0, jtk=p-1 


o 


Proof: Prove it by induction of j. For j — 0, (C.92) holds by the definition of 
relative degree. Assume now that (C.92) holds for some j and prove it for j + 1. 
Recall from the Jacobi identity (Exercise 13.8) that 


Lipa A(z) = D; LaMz) - Lp LsX(z) 


Sce (88] for the proof of Frobenius theorem. 
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for any real-valued function \ and any vector fields f and f. Taking A = Lih and 
B = ad 49, we obtain 


ae L5h(z) = Ly adi gf h(x )= Lu hz) ~ Ly gif h(z) 
We note that the first term on the right-hand Side vanishes since 
jtkriSp-ilojtk«p-1- L;L gu Lfh(z) =0 
; i 


Moreover, 


0, O<j+k+1<p-1 
Lg Lf h(z) - f : 

(719 LaL h(z) » 0, jtktl-p-l 
by the assumption that (C.92) holds for j. Thus, 


0, O<j+k4+1<p-1 
Lies Djh(z) - | 


(-1P* L LA! (a) #0, j+k+l=p-1 


which completes the proof of the lemma. Qa 


Lemma C.9 For all z € D, 


€ 


CX 4€ € € € C OCC OCC CC CO 000mm mnm mmmmmmm^mm: 


e the row vectors dh(x), dL hla)... „dL h(z) are linearly independent; 


* the column vectors g(z), ad jg(x), . .. sad g(x) are linearly independent, 


Proof: We have 


dh(z) 
: | o(2) ... adig) | = 
dL h(x) 
L,h(z) Lad; gh(z) es Laan gh(z) p 
L,Lsh(z) Laae-2ghsh(z) * 
LL  h(z) * T" ; 


bs do odes 
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From the previous lemma, the right-hand side matrix takes the form 


0 ... .. 0 o 
0 o * 
i 3 

o * .. * 


D 


where o denotes a nonzero element. Thus, the matrix is nonsingular, which proves 
the lemma, for if any of the two matrices on the left-hand side has rank less than 
p, their product must be singular. B5 


Lemma C.9 shows that p € n. We are now ready to prove Theorem 13.1. The 
proof for the case p = n follows from Lemma C.9, whose first statement shows that 
[ST /Ox] is nonsingular. Consider the case p < n. The distribution A = span{g} 
is nonsingular, involutive, and has dimension one.!® By Frobenius theorem, A is 
completely integrable. Hence, for every rp € D, there exist a neighborhood Nj 
of zo and n — 1 smooth functions ¢;(z), ..., ón-1(z), with linearly independent 
differentials such that 


Ljóiz)-0, fr1<i<n-1, Vz€N 


Because 
L,Lh(z) =0, for0O<i<p-2 


and dh(z), ..., dL5 ^h(z) are linearly independent, we can use h, ..., L5 *h as 
part of these n — 1 functions. In particular, we take them as ¢p—p41, .... Ọn-1- 
Since L LẸ  h(z) Æ 0, the row vector dL,  h(zo) is linearly independent of the 
row vectors dó, (zo), ..., dós -1(ro). Therefore, 


oT oT : i 
rank [Eeo] sn = az (20) is nonsingular 


and there is a neighborhood No of zo such that T(z), restricted to No, is a diffeo- 
morphism on N. Taking N = N, N Ns completes the proof of the theorem. i| 


C.22 Proof of Theorem 13.2 


The system 
i = f(x) +9(r)u 


15Note that any nonsingular distribution of dimension one is automatically involutive. 


i 
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is feedback linearizable if and only if a sulliciently smooth function A(x) exists such 
that the system l 


£-f(z)-g(z)u y= A(z) 
has relative degree n in Dg C D; that is, h(x) satisfies 
L,Lih(z)z0, forü« i € n —2 and L,L? h(s) #0, Vr€Do (C93) 


Thus, to prove the theorem, we need to show that the existence of h(z) satisfying 
(C.93) is equivalent to conditions 1 and 2. 
Necessity: Suppose there is h(z) satisfying (C.93). Lemma C.9 shows that rank G= 
n. Then, D is nonsingular and has dimension n — 1. From (C.92), with k = 0 and 
p =n, we have 

Ljh(z) = Laa,gh(z) = = Lass h(z) =0 
which can be written as 


dh(z)|g(z), ad; g(), . . .,ad?-*g(z)] = 0 


This equation implies that D is completely integrable and it follows from Frobenius 
theorem that D is involutive. 


Sufficiency: Suppose conditions 1 and 2 are satisfied. Then, D is nonsinguler and 
has dimension n — 1. By Frobenius theorem, there exists h(x) satisfying 


L,h(x) = Ladjgh{z) = ++. = L,a-1,h(z) =0 
Using the Jacobi identity (Exercise 13.8), it can be verified that 
Ljh(z) = LL sh(z) =.. = LL ^ h(z) = 0 
Furthermore, 
dh(x)G(x) = dh(x)[g(z), ad; g(z),. .. ad?" !g(z)] = [0,...,0, Laan- hla) 


Since rank G = n and dh(z) £ 0, it must be true that L an-igh(z) # 0. Using the 
/ 


Jacobi identity, it can be verified that LL h(x) # 0, which completes the proof 
of the theorem. 


C.23 Proof of Theorem 14.6 


For the purpose of analysis, the observer dynamics are replaced by the equivalent 
dynamics of the scaled estimation error 
Ti — Bi; 

gPi-j 


Tij = 
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for 1<i<mand1<j< pi. Hence, we have $ = z — D(e)n, where 


n =. [Mii Mp DEUS 
D(s) = block diag[Di,.... Dm] 
Dj = diag}... 1]o xp, 


The closed-loop system can be represented by 


t = Azrz-Bó(zz,Yy(9,z-— D(e)mQ)) 
z= p(x, 2, 7(8, T — D(e)n, ¢)) 

) = I(9,z- D(e)n,¢) 

eù =  Agn- eBó(z, 2,9, D(e)n) 


where 


6(z, 2,9, D(e)n) = G(x, z, Y(9, 2, ¢)) EX pol, C, a (9, $, Q)) 
and (1/e)Ao = D^! (e)(A — HC)D(ce) is a p x p Hurwitz matrix. For convenience, 
we rewrite the systern in the compact singularly perturbed form 
F(X, D(e)n) 

Aon + eBA(X, D(e)n) 


x 
eù 
where F(X,0) = f(X). The initial states are ¥(0) = (z(0),2(0),2(0)) € S and 


&(0) € Q. Thus, we have 7(0) = D~1(e)(x(0) — (0)]. Setting £ = 0 in (C.95) yields 
7 = 0 and the reduced system 


(C.94) 
(C.95) 


i 


&-f(X) (C.96) 


is nothing, but the closed-loop system under state feedback. The boundary-layer 
model, obtained by applying the change of time variable 7 = t/e then setting € = 0, 
is given by 


Since the origin of (C.96) is asymptotically stable and R is its. region of attraction, 
by (the converse Lyapunov) Theorem 4.17, there is a smooth, positive definite 
function V(¥) and a continuous, positive definite function U(4'), both defined for 
all X € R, such that 
V(&) — oo as X > OR 

oV 

ox 
and for any c > 0, (V(AX) < c) is a compact subset of R. Let S be any compact 
set in the interior of R. Choose positive constants b and c such that c > b > 
maxyes V(X). Then 


SCM ={V(A) < b} C Re = {V(X) se) CR 


f(X)s-U() VER 
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! 
For the boundary-layer system, the Lyapunov function W (n) = n" Pon, where Po is 
the positive definite solution of the Lyapunov equation PyAg+ Aj P = —I, satisfies 


Amin(Po)|lall? < W(n) < Amax(Po)llnl? 


ow 
peck < —|Inll? 
5; Am < -Inl 
where throughout the proof we use ||- || = || - ||z. Due to equivalence of norms, it 
is sufficient to prove (14.114) and (14.115) in the 2-norm. Let 5 = {W(n) < oe?) 
and A = Q. x X. Due to the global boundedness of F and A in £, for all X € Q. 
and 7 € R^, we have f 

E(X, D()ml < kin A(X, Dlejn)|| < kz 
where kj and kz are positive constants independent of €. Moreover, for any 0 < £ < 
1, there is L4, independent of e, such that for all (4,5) € A and every 0 < e < ê, 
we have 

F(X, D(e)n) - F(*,0)] < Zilnll 


We will always consider € < ë. We start by showing that there exist positive 
constants p and € (dependent on g) such that the compact set A is positively 
invariant for every 0 < € € ej. This can be done by verifying that 


V < -U(X) + ek; 


and 
2 1 1 
W<- zla? + 2|mll Pol B|lks < — = lini? + 2\l2)l| || Pollx2 


for all (A, n) € A, where kg = Lı L2 /2/ Amin (Po), || Poll = Amax(Po); ||_Bl| = 1, aud 
La is an upper bound for ||GV/0A|| over N.. Taking o = 16k2||Fo[| aud e1 = 8/Ka. 
where f = minxcoaa, U(X), it can be shown that, for every 0 < € € &, we liave 
V <0 for all (4,2) € (V(X) = c) x E and W < 0 for all (3,5) € €; x (W(r) = 
oe}. Hence, A is positively invariant. 

Now we consider the initial state (X (0), 2(0)) € Sx Q. It can be verified that. the 
corresponding initial error (0) satisfies ||n(0)|| < k/e(^»^*7? for some nonnegative 
constant k dependent on S and Q, where pmax = max {P1,....Pm}- Since (0) is in 
the interior of Q., it can be shown that 


là (t) ~ &(0)] < kıt (C.97) 


as long as X(t) € Q.. Thus, there exists a finite time To, independent of €, such 
that X(t) € Qe for all t € [0, To]. During this time interval, we have 


1 1 1 
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since 
Wn) > oe? => ||Polliln||? 2 16k2|Pol?e? <> linll = 4kellPolle 


Therefore, " 
W(n(£) € 5 5 exe (-ait/e) (C.98) 
where c; = 1/(2l|Po||) and e? = &?||Po||. Choose &2 > 0 small enough that 


T(c) € £i ( 22 


«imn 
01 rem = 270 


for all 0 < € € £2. We note that £2 exists, since T(c) tends to zero as e tends to zero. 
It follows that W(n(T(e))) € ge? for every 0 < € € e2. Taking ef = min {é, €1, €2} 
guarantees that, for every 0 < € < ef, the trajectory (X(t), n(t)) enters A during the 
interval [0,T(e)] and remains there for all t > T(e). Consequently, the trajectory 
is bounded for all t > T(e). On the other hand, for t € [0,T(e)], the trajectory is 
bounded by virtue of inequalities (C.97) and (C.98). 

Next, we show (14.114). We know that, for every 0 < e € ej, the solutions are 
inside the set A for all £ > T(e), where A is O(e) in the direction of the variable 7. 
Thus, we can find ¢3 = €3(1) € ej such that, for every 0 < € € ea, we have 


Ibl €u/2  vtzT(e) - TQ) (C.99) 
Using the fact that V < —U (z) + ekg for all (4,7) € A, we conclude that 
| V«-ÀU(z) for X d (U(X) < 2kse $ v(e)) (C.100) 


Because U(X) is positive definite and continuous, the set {U(¥) € v(e)) is a 
compact set for sufficiently small e. Let co(e) = maxpy(xj«v(e)(V(AX)); cole) is 
nondecreasing and lim, ,oco(c) = 0. Consider the compact set (V(X).« co(e)}. 
We have (U(X) < v(e)) c (V(X) < co(e)). Choose £4 = e4(p) < ef small enough 
such that, for all e € £4, the set {U (X) < v(e)} is compact, the set (V(AX) < co(&)) 
is in the interior of Qe, and ` 


(V(X) < co(e)} c {IÆ € u/2) = (C101) 


Then, for all X' € Qe, but X d (V(X) € co(e)}, we have an inequality similar 
to (C.100). Therefore, we conclude that the set (V(A) < co(e)} x E is positively 
invariant and every trajectory in 2, x E reaches {V (Æ)  co(c)) x Y in finite time. 
In other words, given (C.101), there exists a finite time T = T'(u) such that for 


every 0 < € < £4 f 
IXO u2 Vert (C.102) 


Take e3 = &5(u) = min(es,e4) and T» = T»(u) = max{T,T}. Then, (14.114) 
follows from (C.99), (C.102), ĉ = x — D(e)n, and ||D(e)|| = 1. 

To show (14.115), we divide the interval [0, oo) into three intervals [0, T(&)], 
[T(e), T3], and [73,c0) and show (14.115) for each interval. From the ultimate 
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boundedness of A (0), shown in (14,114), and the asymptotic stability of the origin 
of (C.96), we conclude that there exists a finite time T3 > T(e), independent of e, 
such that, for every 0 < € € £3, we have 


|) - #(t) | Su, YET (C.103) 
From (C.97), we know that 
lx (6 — a'(0)] < kıt 
during the interval [0, T(e)]. Similarly, it can be shown that 
l6) - a (0) € kıt 
during the same interval. Hence, 
|t) - X(t) < 2 Tle), Y te [0,T(e)] 


Since T(e) — 0 as € — 0, there exists 0 « eg < ez such that, for every 0 < € < es, 
we have 
lat) - XA su, Vee [0,T()] (C.104) 


Over the interval [T(e), T3], the solution X(t) satisfies 
& = F(X, D(e)n(t)), with [|X (T(e)) - X(T (e) < Ale) 


where D(e)n is O(e) and 6;(€) 0 as e — 0. Thus, by Theorem 3.5, we conclude 
that there exists 0 < eg € €} such that, for every 0 < € < &g, we have 


IÆ) -XOS vte[r(), m] (C.105) 
Take e$ = min{és,€6}. Then, (14.115) follows from (C.103) through (C.105). 


Finally, assuming that the origin of (C.96) is exponentially stable, it follows from l 


(the converse Lyapunov) Theorem 4.14 that there exists a continuously differentiable 
Lyapunov function Vi (AX) which satisfies the inequalities 


ôV 


av, 
hil SVR Shr, GEPOS- [3 


< b4| |l 


over the ball B, C R for some positive constants r, bı, bo, ba, and bg. Using the 
local Lipschitz property of F and A and the fact that F(0, 0) = 0 and A(0,0) =0, 
it can be shown that the composite Lyapunov function V2(4’,7) = V(X) + W(n) 
satisfies 


Va < -yTQy 


hs B rum kv | 


where 
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for some nonnegative constants 3, and fj. The matrix Q will be positive definite 
for sufficiently small e. Hence, there is a neighborhood WN of the origin, independent 
of e, and &; > 0 such that for every 0 < € < er, the origin is exponentially stable 
and every trajectory in M converges to the origin as t — oo. By (14.114), there 
exists £g > 0 such that for every 0 < € < ea, the solutions starting in S x Q enter N 
in finite time. Hence, for every 0 < € € ej = min{e7, eg), the origin is exponentially 
stable and S x Q is a subset of the region of attraction. 


4 


Do (———— ÓÓ d 


rr 


Notes and References 


The main references used in the preparation of this text are Hirsch and Smale [81], 
Hale [75], and Miller and Michel [135] for the theory of ordiuary differential equa- 
tions; Hahn [72], Krasovskii [107], and Rouche, Habets, and Laloy [154] for stability 
theory; and the texts by Vidyasagar [201](first edition) and Hsu and Meyer [85]. 
References for the various topics are listed under the respective chapters. The ap- 
pendices on mathematical review and contraction mapping have been patterned 
after similar summaries in Bertsckas [27] and Luenberger [121]. For a complete 
coverage of topics in these appendices, the reader may consult any text on mathe- 
matical analysis. We have used Apostol [10]. Other standard texts are Rudin [157] 
and Royden [156]. 


Chapter 1. The tunnel diode circuit and negative resistance oscillator are 
taken from Chua, Desoer, and Kuh [39]. The presentation of the mass-spring sys- 
tem is based on Mickens [134] and Southward [184]. The Hopfield neural network 
description is based on Hopfield [82] and Michel, Farrel and Porod [131]. The adap- 
tive control example is based on Sastry and Bodson [168]. An interesting book to 
read about nonlinear phenomena, including chaos, is Strogatz [187]. 


Chapter 2. The classical material on second-order systems in Sections 2.1 
to 2.4 can be found in almost any text on nonlinear systems. Our presentation 
lias followed closely the lucid presentation of Chua, Desoer, and Kuh [39]. . Sec- 
tion 2.5 is based on Parker and Chua [149]. Section 2.6 is based on Hirsch and 
Smale [81, Chapters 10 and 11], Guckenheimer and Holmes [70, Section 1.8], and 
Strogatz [187]. The bifurcation material of Section 2.7 is based on [70] and [187]. 


Chapter 3. The material in Sections 3.1-3.3 is standard and can be found in 
one form or the other in any graduate text on ordinary differential equations. Sec- 
tion 3.1 comes very close to the presentation in Vidyasagar [201], while Sections 3.2 
and 3.3 are based on Hirsch and Smale [81] aud Coppel [43]. The comparison prin- 
ciple is based on Hale [75], Miller aud Michel [135], and Yoshizawa [213]. 
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Chapter 4. Hahn [72], Krasovskii [107], and Rouche, Habets, and Laloy [154] 
are authoritative references on Lyapunov stability. The presentation style of Sec- 
tion 4.1 is influenced by Hirsch and Smale [81]. The proof of Theorem 4.1 is takcn 
from Hirsch and Smale [81, Section 9.3], while that of Theorem 4.3 is based on 
Hahn (72, Section 25], Hale [75], and Miller and Michel [135]. The invariance prin- 
ciple presentation of Section 4.2 follows the original work by LaSalle [112]. The 
proof of Lemma 4.1 is based on Rouche, Habets, and Laloy’ [154, Appendix n. 
The application of the invariance principle to neural networks is standard and can 
be found in Hopfield [82]. Our presentation is influenced by Salam [163]. See also 
Cohen and Grossberg [42] for a generalization of Example 4.11. The material on 
linear time-invariant systems in Section 4.3 is taken from Chen [35]. The proof of 
Theorem 4.6 is taken from Kailath [94]. The proof of Theorem 4.7 on lineariza- 
tion is guided by Rouche and Mawhin [155, Sections 1.6 and 1.7], which includes 
a careful treatment of the case when the linearization has at least one eigenvalue 
in the right-half plane with other eigenvalues on the imaginary axis. The proof 
of Lemma 4.3 is taken from Hahn (72, Section 24B]. The statement and proof of 
Lemma 4.4 is guided by Hahn (72, Section 24E] and Sontag [181, Lemma 6.1]. The 
proof of Lemma 4.5 is taken from Hahn [72, Section 35] (for the local part) aud 
Lin, Sontag, and Wang [118] (for the global part). The proofs of Theorems 4.8 and 
4.9 combine ideas from Hahn [72, Section 25] and Rouche, Habets, and Laloy [154, 
Section L6]. Section 4.6 is based on Vidyasagar [201]. The proofs of the converse 
Lyapunov theorems are based on Krasovskii [107, Theorem 11.1] for Theorem 4.14, 
Miller and Michel [135, Section 5.13] and Hahn [72, Section 49], with some insight 
from Hoppensteadt [83], for Theorem 4.16, and Kurzweil [109] and Lin, Sontag, 
and Wang [118] for Theorem 4.17. The proof of Theorem 4.18 is guided by Miller 
and Michel [135, Theorem 9.14] and Corless: and Leitmann [45]. The concept of 
input-to-state stability was introduced by Sontag [181], who proved a few basic 
results. (See [182].) Our presentation benefited from a nice exposition in Krstic, 
Kanellakopolous, and Kokotovic [108]. 


Chapter 5. The treatment of £-stability in Sections 5.1 and 5.2 is based on 
Desoer and Vidyasagar [53] and Vidyasagar [201]. Section 5.3 on the Z£»-gain is 
based on van der Schaft [199], with help from the papers by Willems [209] and 
Hill and Moylan [77], [79] on dissipative systems. The proof of Theorem 5.4 is 
based on [53, Section 2.6], [200, Section 3.1.2], and [220, Section 4.3]. The small- 
gain theorem presentation is based on Desoer and Vidyasagar [53] and the tutorial 
article by Teel, Georgiou, Praly, aud Sontag [192]. Example 5.14 is taken from [192]. 


Chapter 6. The passivity approach is based on several references, including Hill 
and Moylan [77], [78], Sepulchre, Jankovic, and Kokotovic [172], Byrnes, Isidori and 
Willems [31], Krstic, Kanellakopoulos, and Kokotovic [108], Teel, Georgiou, Praly, 
and Sontag [192], and Vidyasagar [201]. An expanded treatment of positive real 
transfer functions and the positive real lemma is given in Anderson and Vongpan- 
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itlerd [0]. The proof of Lemma 6.1 is based on Tao and Ioannou [190] and Wen [206]. 
The proofs of Lemmas 6.2 and 6.3 are based on Anderson [4]. 


Chapter 7. Absolute stability has a long history in the control theory liter- 
ature. For a historical perspective, see Hsu and Meyer [85, Sections 5.9 and 9.5]. 
Our presentation of the circle and Popov criteria is based on Hsu and Meyer [85. 
Section 9.5 and Chapter 10], Vidyasagar [201], Siljak (174, Sections 8.6 through 
8.9 and Appendix H], and Moore and Anderson [138]. A comprehensive coverage 
of absolute stability can be found in Narendra and Taylor [140]. Detailed treat- 
ment of the describing function method can be found in Atherton [18] and Hsu and 
Moyer [85, Chapters 6 and 7]. Our presentation in Section 7.2 follows Mees [128, 
Chapter 5]. The proof of Lemma 7.1 is taken from Mees and Bergen [130]. The 
proof of Theorem 7.4 is based on Mees and Bergen [130] and Bergen aud Franks [25]. 
The presentation of the error analysis has gained a lot from a lucid presentation in 
Siljak [174, Appendix G], from which Example 7.14 is taken. 


Chapter 8. Section 8.1 is based mostly on Carr [34], with help from Guck- 
enheimer and Holmes [70]. The proofs of Theorems 8.1 and 8.3 are taken from 
Carr [34, Chapter 2]. The proof of Theorem 8.2 by using Lyapunov analysis is 
simpler than the proof given iu Carr [34]. Corollary 8.1 was suggested to the author 
by Miroslav Krstic. The proof of Lemma 8.1 is based on Hahn [72, Section 33]. 
Example 8.10 is taken from Willems [210]. There is a vast literature on estimating 
the region of attraction. Some methods are described or surveyed in [28], [37], [65]. 
[80], [133], and [143]. The proof of Lemma 8.2 is taken from Popov [152, page 211]. 
The proof of Theorem 8.5 is based on Sastry and Bodson [168, Theorem 1.5.2]. The 
discussion on the stability of periodic solutions in Section 8.4 is based on Hahn [72, 
Section 81], Miller and Michel [135, Section 6.4], and Hale [75, Section VI.2]. A 
natural continuation of this discussion is the Poincaré map method, which is de- 
scribed in Hirsch and Smale (81, Chapter 13] and Guckenheimer and Holmes (70, 
Section 1.5]; see also the second edition of this text. 


Chapter 9. The material of Sections 9.1 and 9.2 is based on a vast literature 
on robustness analysis in control theory. We can say, however, that the basic ref- 
erences are Hahn (72, Section 56] and Krasovskii [107, Sections 19 and 24]. Similar 
results are given in Coppel [43, Section II.3] for the case when the nominal system 
is linear, but the derivation is not based on Lyapunov theory; instead, it uses prop- 
erties of fundamental matrices. The case of nonvanishing perturbations is referred 
to in Hahn [72] and Krasovskii [107] as the case of “persistent disturbance." The 
results on nonvanishing perturbations are also related to the concept of total stabil- 
ity. (See Hahn [72, Section 56].) The comparison method of Section 9.3 is based on 
sporadic use of the comparison lemma in the control literature. Section 9.5, on the 
stability of interconnected systems, is based mostly on the tutorial paper Araki [11], 
with help from the research inonographs Siljak [175] and Michel and Miller [132]. 
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The neural network example is taken from Michel, Farrel, and Porod [131]. The 
treatment of slowly varying systems is based on Desoer and Vidyasagar [53, Sec- 
tion IV.8], Vidyasagar [201], Kokotovic, Khalil, and O'Reilly [105, Section 5.2], and 
Hoppensteadt [83]. Lemma 9.8 is a specialization of Lemma 2 of Hoppensteadt [83] 
to the case of exponential stability. 


Chapter 10. The perturbation method of Section 10.1 is classical and can 
be found in many references. A detailed treatment can be found in Kevorkian and 
Cole [98] and Nayfeh [141]. The asymptotic results of Theorems 10.1 and 10.2 
are adapted from Hoppensteadt's work on singular perturbations. (See Hoppen- 
steadt [84].) Section 10.3 is based on Halanay (75, Section 3.4]. The presentation 
of the averaging method in Section 10.4 is based on Sanders and Verhulst [166], 
Hale [75, Section V.3], Halanay [73, Section 3.5], and Guckenheimer and Holmes [70,. 
Sections 4.1 and 4.2]. The vibrating pendulum example is taken from Tikhonov, 
Vasileva, and Volosov [194]. The application of averaging to weakly nonlinear os- 
cillators in Section 10.5 is based on Hale [75, pp. 183-186]. The presentation of 
general averaging in Section 10.6 is based on Sanders and Verhulst [166], Hale [75, 
Section V.3], and Sastry and Bodson [168, Section 4.2]. 


Chapter 11. The presentation of the singular perturbation method follows very 

closely Kokotovic, Khalil, and O'Reilly [105]. The proofs of Theorems 11.1 and 
` 11. adapt ideas from Hoppensteadt [83]. We have not included the construction of 
higher order approximations. For thet, the reader may consult Hoppensteadt [84], 
Butuzov, Vasileva, and Fedoryuk [29], or O'Malley[145]. The articles [83], [84]. and 
[29] appear in Kokotovic and Khalil [104]. Example 11.11 is taken from Tikhonov, 
Vasileva, and Volosov [194]. For extensions of this example, see Grasman [68]. The 
proofs of Theorems 11.3 and 11.4 are based on Saberi and Khalil [160]. 


Chapter 12. The design vie linearization approach of Section 12.2 is standard 
and can be found in almost any book on nonlinear control. The use of integral 
control is also standard, but the results given in Section 12.4 can be traced back 
to Huang and Rugh [86] and Isidori and Byrnes [91]. The gain scheduling presen- 
tation of Section 12.5 is based Lawrence and Rugh [114] and Kaminer, Pascoal, 
Khargonekar, and Coleman [96], with help from Astrom and Wittenmark [15] and 
Rugh and Shamma [159]. 


Chapter 13. The feedback linearization chapter is based mainly on Isidori [88]. 
The lucid introduction of Section 13.1 is based on Spong and Vidyasagar [185, Chap- 
ter 10]. The local stabilization and tracking results are based on Isidori [88, Chapter 
4]. The global stabilization material is based on many references, as the global sta- 
bilization problem has caught the attention of several researchers. The papers [30], 
[46], [119], [161], [188], and [196] and the books [88], (108], [124], and [172] will guide 
the reader to the basic results on global stabilization, not only for the problem for- 
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mulation presented here, but, also for more general problem forinulations, inchiding 
problems treated in the backstepping Section 14.3. Examples 13.16, 13.17. and 
13.19 are taken from [30]. [188], and [62], respectively. 


Chapter 14. The sliding mode control section is based on the books by 
Utkin [198] and Slotine and Li [180], and the tutorial papers by DeCarlo, Zak, 
and Matthews [52] and Young, Utkin, and Ozguner [215]. Analysis of the con- 
tinuous approximation of sliding mode controllers is based on [55]. The Lyapunov 
redesign section is guided by Corless and Leitmann [45], Barmish, Corless, and Leit- 
mann [19], and Spong and Vidyasagar [185, Chapter 10]. See also Corless [44] for a 
survey of the use of Lyapunov redesign in the control of uncertain nonlinear systems. 
The robust stabilization design of Section 14.2.1 is also known as min-max control. 
The nonlinear damping of Section 14.2.2 is based on Krstic, Kanellakopolous, and 
Kokotovic [108, Section 2.5]. The backstepping section is based mainly on the same 
reference [108], with help from Qu [153] and Slotine and Hedrick [179]. The book 
[108] contains a comprehensive treatment of the backstepping design procedure, in- 
cluding its application to adaptive control of nonlinear systems. Backstepping is 
a recursive method that helps reduce the complexity of nonlinear systems. Other 
recursive methods include forwarding and interlacing [153], [172] and composite con- 


trol of singularly perturbed systems [105]. The material on passivity-based control : 


follows Sepulchre, Jankovic, and Kokotovic [172] and van der Schaft [199]. Exten- 
sive application of the method to physical systems can be found in [120] and [146]. 
The section on high-gain observers is based on Esfandiari and Khalil [56] and Atassi 
and Khalil [16]. 


Other references, which were consulted occasionally during the preparation of 
this text, are included in the bibliography. 


y€* *9999*9?*9?99"??"9»9??9?9*9*9?797€?270€€€€€ «eec cece a a an 


Y 


Bibliography 


[1] D. Aeyels and J. Peuteman. À new asymptotic stability criterion for nonlinear 
time-varying differential equations. IEEE Trans. Automat. Contr., 43:968- 


971, 1998. 
(2] J. K. Aggarwal. Notes on Nonlinear Systems. Van Nostrand Reinhold, New 
York, 1972. 


: (3] B. Aloliwi, H. K. Khalil, and E. G. Strangas. Robust speed control of induction 
motors. In Proc, American Control Conf., Albuquerque, NM, 1997. WP16:4. 


[4] B. D. O. Anderson. A system theory criterion for positive real matrices. STAAL 
J. Control, 5:171-182, 1967. 

[5] B. D. O. Anderson, R. R. Bitmead, C. R. Johnson, Jr., P. V. Kokotovic, R. L. 
Kosut, I. M. Y. Mareels, L. Praly, and B. D. Riedle. Stability of Adaptive 
Systems. MIT Press, Cambridge, MA, 1986. 

[6] B. D. O. Anderson and S. Vongpanitlerd. Network Analysis and Synthesis: 
A Modern Systems Theory Approach. Prentice-Hall, Englewood Cliffs, NJ, 
1973. 

[7] A. A. Andronov, A. A. Vitt, and S. E. Khaikin. Theory of oscillators. Dover, 
New York, 1966. 

[8] A. M. Annaswamy. On the input-output behavior of a class of second-order 
nonlinear adaptive systems. In American Control Conference, pages 731—732, 
1989. 


[9| P. J. Anstaklis and A. N. Michel. Linear Systems. McGraw-Hill. New York, 
1997. 


[10] T. M. Apostol. Mathematical Analysis. Addison- Wesley, Reading, MA, 1957. 


[11] M. Araki. Stability of large-scale nonlinear systeins-quadratic-order theory of 
composite-system inetliod using AJ-matrices. [IEEE Trans. Automat. Contr.. 


AC-23:129-141, 1978. 


725 


726 BIBLIOGRAPHY 


[12] B. Armstrong and C. Canudas de Wit. Friction modeling and compensation. 
In W. Levine, editor, The Control Handbook, pages 1369-1382. CRC Press, 
1996. 


[13] D. K. Arrowsmith and C. M. Place. Ordinary Differential Equations. Chap- 
man and Hall, London, 1982. 


[14] R. B. Ash. Real Analysis and Probability. Academic Press, New York, 1972. 


[15] K. J. Astrom and B. Wittenmark. Adaptive Control. Honan Read- 
ing, MA, second edition, 1995. 


[16] A. N. Atassi and H. K. Khalil. A separation principle for the stabilization 
of a class of nonlinear systems. IEEE Trans. Automat. Contr., 44:1672-1687, 
1999. 


[17] D. P. Atherton. Stability of Nonlinear Systems. John Wiley, New York, 1981. 


[18] D. P. Atherton. Nonlinear Control Engineering. Van Nostrand Reinhold, 
London, student edition, 1982. 


[19] B. R. Barmish, M. Corless, and G. Leitmann. A new class of stabilizing 
controllers for uncertain dynamical systems. SIAM J. Control & Optimization, 
21:246-255, 1983. 


[20] T. Basar and P. Bernhard. Ha; -Optimal Control and Related Minimax Design 
Problems. Birkhauser, Boston, second edition, 1995. 


[21] R. Bellman. Introduction to Matriz Analysis. McGraw-Hill, New York, second 
edition, 1970. 


[22] R. E. Bellman, J. Bentsman, and S. M. Meerkov. Vibrational control of 
nonlinear systems; Vibrational controllability and transient behavior. IEEE 
Trans. Automat. Contr., AC-31:717-724, 1986. 


[23] B.W. Bequette. Process Dynamics: Modeling, Analysis, and Simulation. 
Prentice Hall, Upper Saddle River, NJ, 1998. 


[24] A. R. Bergen, L. O. Chua, A. I. Mees, and E. W. Szeto. Error bounds 
for general describing function problems. IEEE Trans. Circuits Syst., CAS- 
29:345-354, 1982. 


[25] A. R. Bergen and R. L. Frank. Justification of the describing function method. 
SIAM J. Control, 9:568-589, 1971. 


[26] M. Berger and M. Berger. Perspectives in Nonlinearity. W. A. Benjamin, 
New York, 1968. 


BIBLIOGRAPHY 727 


[27] D. P. Bertsekas. Dynamic Programming. Prentice-Hall, Englewood Cliffs, NJ, 
1987. ‘ , 


[28] F. Blanchini. Set i invariance in control-a survey. Automatica, 35:1747-1767, 
1999. 


[29] V. F. Butuzov, A. B. Vasileva, and M. V. Fedoryuk. Asymptotic methods in 
the theory of ordinary differential equations. In R. V. Gamkrelidze, editor, 
Mathematical Analysis, volume 8 of Progress in Mathematics, pages 1-82. 
Plenum Press, New York, 1970. 


[30] C. I. Byrnes and A. Isidori. Asymptotic stabilization of minimum phase non- 
linear systems. JEEE Trans. Automat. Contr., 36:1122-1137, 1991. 


[31] C. I. Byrnes, A. Isidori, and J. C. Willems. Passivity, feedback equivalence, 
and the global stabilization of minimum phase nonlinear systems. IEEE Trans. 
Automat. Contr., 36:1228-1240, 1991. 


[32] C. I. Byrnes, F. D. Priscoli, and A. Isidori. Output Regulation of Uncertain 
Nonlinear Systems. Birkhauser, Boston, 1997. 


[33] F. M. Callier and C. A. Desoer. Multivariable Feedback Systems. Springer- ` 


. Verlag, New York, 1982. 


[34] J. Carr. Agplications of Centre Manifold Theory. Springer-Verlag, New York, 
1981. 


[35] C. T. Chen. Linear System Theory and Design. Holt, Rinehart and Winston, 
New York, 1984. 


[36] H. D. Chiang, M. W. Hirsch, and F. F. Wu. Stability regions of nonlinear 
autonomous dynamical systems. IEEE Trans. Automat. Contr., 33:16-27, 
1988. 


[37] H. D. Chiang and J. S. Thorp. Stability regions of nonlinear dynamical sys- 
tems: a constructive methodology. IEEE Trans. Automat. Contr., 34:1229- 
1241, 1989. 


[38] J. H. Chow, editor. Time-Scale Modeling of Dynamic Networks with Ap- 
plications to Power Systems. Number 46 in Lecture Notes in Control and 
Information Sciences. Springer-Verlag, New York, 1982. 


[39] L. O. Chua, C. A. Desoer, and E. 8. Kuh. Linear and Nonlinear Circuits. 
McGraw-Hill, New York, 1987. | 


[40] L. O. Chua and Y. S. Tang. Nonlinear oscillation via volterra series. IEEE 
Trans. Circuits Syst., CAS-29:150-168, 1982. 


enw wee MRM OOOO OOO CE OOOO OCOOCOCCOCE 


Y 


728 | BIBLIOGRADIIY 


. H] C. M. Close and D. K. Frederick, Modeling and Analysis of Dynamic Systems, 
E Houghton Mifflin, Boston, second edition, 1993. 

we 

42] M. A. Cohen and S. Grossberg. Absolute stability of global pattern formation 

n and parallel memory storage by competitive neural networks. IEEE Trans. 
E Syst. Man, Cybern., 13:815-826. 1983. i 

z 43] W. A. Coppel. Stability and Asymptotic Behavior of Differential Equations. 
J D. C. Heath, Boston, 1965. 

j [44] M. Corless. Control of uncertain nonlinear systems. J, Dyn. Sys. Measurement 
a and Control, 115:362-372, 1993. 

= X [45] M. Corless and G. Leitmaun. Continuous state feedback guaranteeing uniform 
D ultimate boundedness for uricertain dynamic systems. IEEE Trans. Automat. 
^ Contr., AC-26:1139-1144, 1981. 

oe 

~ [46] J. M. Coron, L. Praly, and A. Teel. Feedback stabilization of nonlinear sys- 
3t tems: sufficient conditions and Lyapunov and input-output techniques. In 
vé A. Isidori, editor, Trends in Control pages 293-347. Springer-Verlag, New 
= York, 1995. 

A : 

A 47] A. M. Dabroom and H. K. Khalil. Output feedback sampled-data control of 
d nonlinear systems using high-gain observers. JEEE Trans. Automat. Contr., 
s > 46, 2001. 

d ; : 

È 48] M. A. Dahleh and I. J. Diaz-Bobillo. Control of Uncertain Systems: A Lincar 
^j Programming Approach. Prentice Hall, Upper Saddle River, NJ, 1995. 

pi 49] E. J. Davison. The robust control of a servomechanism problem for linear 
^ time-invariant multivariable systems. IEEE Trans. Automat. Contr., AC- 
4 21:25-34, 1976. 

K 50] D. M. Dawson, J. Hu, and T. C. Burg. Nonlinear Control of Electric Machin- 
Lu ery. Marcel-Dekker, New York, 1998. 
E 51] R. A. Decarlo. Linear Systems. Prentice-Hall, Englewood Cliffs, NJ, 1989. 
». ` 
5 [52] R. A. DeCarlo, S. H. Zak, and G. P. Matthews. Variable structure control 
e . of nonlinear multivariable systems: A tutorial Proc. of IEEE, 76:212-232, 
vr 1988. 


H 
2 


[53] C. A. Desoer and M. Vidyasagar. Feedback Systems: Input-Output Properties. 
Academic Press, New York, 1975. 


[54] J. C. Doyle, K. Glover, P. P. Khargouekar, and B. A. Francis. State-space 
solutions to standard Ho and H control problems. IEEE Trans. Automat. 
Contr., 34:831-847, 1989. 


DUIS NON SN NON. 


» 


T BIBLIOGRAPHY — - 729 


[55] F. Esfandiari and 11. K. Khalil, Stability annlysis of a continuous implementa- 
tion of variable structure control. IEEE Trans. Automat. Contr., 36:616-620, 
1991. 


[56] F. Esfandiari and H. K. Khalil. Output feedback stabilization of fully lineariz- 
able systems. Int. J. Contr., 56:1007-1037, 1992. 


[57] M. Fiedler and V. Ptak. On matrices with nonnegative off-diagonal elements 
and positive principal minors. Czech. Math. J., 12:382-400, 1962. 


[58] A. F. Filippov. Differential equations with discontinuous right-hand side. 
Amer. Math. Soc. Translations, 42:199—231, 1964. 


[59] A. M. Fink. Almost Periodic Differential Equations. Number 377 in Lecture 
Notes in Mathematics. Springer-Verlag, New York, 1974. 


[60] T. L Fossen. Guidance and Control of Ocean Vehicles. John Wiley & Sons, 
New York, 1994. 


[61] B. A. Francis. A course in Hoo control theory, volume 88 of Lect. Notes Contr. 
Inf Sci. Springer-Verlag, New York, 1987. 


[62] R. A. Freeman and P. V. Kokotovic. Optimal nonlinear controllers for feed- 
back linearizable systems. In Proc. American Control Conf., pages 2722-2726, 
Seattle, WA, 1995. 


[63] F. R. Gantmacher. Theory of Matrices. Chelsea Publ., Bronx, NY, 1959. 
[64] F. M. Gardner., Phaselock Techniques. Wiley-Interscience, New York, 1979. 


[65] R. Genesio, M. Tartaglia, and A. Vicino. On the estimation of asymptotic 
stability regions: State of the art and new proposals. IEEE Trans. Automat. 
Contr., AC-30:747-755, 1985. 


[66] S. T. Glad. On the gain margin of nonlinear and optimal regulators. IEEE 
Trans. Automat. Contr., AC-29:615-620, 1984. 


[67] G. H. Golub and C. F. Van Loan. Matrix Computations. The John Hopkins 
University Press, Baltimore, 1983. 


[68] J. Grasman. Asymptotic Methods for Relaxation Oscillations and Applica- 
tions. Number 63 in Applied Mathematical Sciences. Springer-Verlag, New 
York, 1987. 


[69] M. Green and D. J. N. Limebeer. Linear Robust Control. Prentice Hall, 
Englewood Cliffs, NJ, 1995. 


[70] J. Guckenheimer and P. Holmes. Nonlinear Oscillations, Dynamical Systems, 
and Bifurcations of Vector Fields. Springer-Verlag, New York, 1983. 


730 BIBLIOGRAPHY 


[71] V. Guillemin and A. Pollack. Differential Topology. Prentice-Hall, Englewood 
Cliffs, NJ, 1974. 


[72] W. Hahn. Stability of Motion. Springer-Verlag, New York, 1967. 


[73] A. Halanay. Differential Equations: Stability, Oscillations, Time Lags, vol- 
ume 23 of Mathematics in Science and Engineering. Academic Press, New 
York, 1966. 


[74] J. Hale and H. Kocak. eens and Bifurcations. Springer-Verlag. ‘New 
York, 1991. 


[75] J. K. Hale. Ordinary Differential Equations. Wiley-Interscience, New York, 
1969. 


[76] P. Hartman. Ordinary Differential Equations. Wiley, New York, 1964. 


[77] D. Hill and P. Moylan. The stability of nonlinear dissipative systems. IEEE 
Trans. Automat. Contr., AC-21:708-711, 1976. 


[78] D. J. Hill and P. J. Moylan. Stability results for nonlinear feedback systems. 
Automatica, 13:377-382, 1977. 


[79] D. J. Hill and P. J. Moylan. Dissipative dynamical systems: basic input- 
output and state properties. J. of The Franklin Institute, 309:327-357, 1980. 


[80] H. Hindi and S. Boyd. Analysis of linear systems with saturation using convex 
optimization. In Proc. IEEE Conf. on Decision and Control, pages 3081-3086, 
Tampa, FL, 1998. 


[81] M. W. Hirsch and S. Smale. Differential Equations, Dynamical Systems, and 
Linear Algebra. Academic Press, New York, 1974. 


[82] J. J. Hopfield. Neurons with graded response have collective computational 
properties like those of two-state neurons. Proc. of the Natl. Acad. Sci. U.S.A., 
81:3088-3092, May 1984. 


[83] F. C. Hoppensteadt. . Singular perturbations on the infinite interval. Trans. 
Amer. Math. Soc., 123:521-535, 1966. 


[84] F. C. Hoppensteadt. Properties of solutions of ordinary differential equations 
with small parameters. Comm. Pure Appl. Math., 24:807-840, 1971. 


[85] J. C. Hsu and A. U. Meyer. Modern Control Principles and Applications. 
McGraw-Hill, New York, 1968. 


[86] J. Huang and W. J. Rugh. On a nonlinear multivariable servomechanism 
problem. Automatica, 26:963-972, 1990. 


BIBLIOGRAPHY 731 


[87] P. A. Ioannou and J. Sun. Robust Adaptive Control. Prentice Hall, Upper 
Saddle River, NJ, 1995. 


[88] A. Isidori. Nonlinear Control Systems. Springer-Verlag, Berlin, third edition, 
1995. 


i 


[89] A. Isidori. Nonlinear Control Systems II. Springer-Verlag, London, 1999. 


[90] A. Isidori and A. Astolfi. Disturbance attenuation and Hæ control via mea- 
surement feedback in nonlinear systems. IEEE Trans. Automat. Contr., 
37:1283-1293, 1992. 


\ 


[91] A. Isidori and C. I. Byrnes. Output regulation of nonlinear systems. IEEE 
Trans. Automat. Contr., 35: duc —140, 1990. 


[92] A. Isidori, S. S. Sastry, P. V. Kokotovic, and C. I. Byrnes. Singularly perturbed 
zero dynamics of nonlinear systems. IEEE Trans. Automat. Contr., 37:1625- 
1631, 1992. 


[93] Z. P. Jiang, A. R. Teel, and L. Praly. Small gain theorem for ISS systems and 
applications. Mathematics of Control, Signals, and Systems, 7:95-120, 1995. 


[94] T. Kailath. Linear Systems. Prentice-Hall, Englewood Cliffs, NJ, 1980. 


[95] R. E. Kalman and J. E. Bertram. Control system analysis and design via the 
"second method" of Lyapunov, parts I and II. Journal of Basic Engineering, 
82:371-400, 1960. 


[96] I. Kaminer, A. M. Pascoal, P. P. Khargonekar, and E. E. Coleman. A velocity 
algorithm for the implementation of gain scheduled controllers. Automatica, 
31:1185-1191, 1995. 


[97] T. R. Kane, P. W. Likins, and D. A. Levinson. Spacecraft Dynamics. McGraw- 
Hill, New York, 1982. 


[98] J. Kevorkian and J. D. Cole. Perturbation Methods in Applied Mathematics. 
Number 34 in Applied Mathematical Sciences. Springer-Verlag, New York, 
1981. 


[99] H. K. Khalil. Stability analysis of nonlinear multiparameter singularly per- 
turbed systems. JEEE Trans. Automat. Contr., AC-32:260-263, 1987. 


[100] H. K. Khalil. High-gain observers in nonlinear feedback control. In H. Nijmei- 
jer and T. I. Fossen, editors, New Directions in Nonlinear Observer Design, 
volume 244 of Lecture Notes in Control and Information Sciences, pages 249- 
268. Springer, London, 1999. 


[101] P. P. Khargonekar, I. R. Petersen, and M. A. Rotea. H..-optimal control with 
state feedback. IEEE Trans. Automat. Contr., 33:186- 188, 1988. 


|»P?»9292229?92922???2??7999?79€0€€€6€€0€€feeeee]|cco)cec 


-— 


Y 


o 


— 


$3 


t 


QNONON OA I 


"i 
Pa 


)* 9X x 


TSS FRG V 


» 


Pe Oe ee RE 


ioe cece omar ame d 


732 BIBLIOGRAPHY 


[102] H. W. Knobloch and B. Aulbach. Singular perturbations and integral mani- 
folds. J. Math. Phys. Sci., 18:415-424, 1984. ~ 


[103] P. Kokotovic and M. Arcak. Constructive nonlinear control: a historical 
perspective. Automatica, 37:637-662, 2001. 


[104] P. V. Kokotovic and H. K. Khalil, editors. Singular Perturbations in Systems 
and Control. IEEE Press, New York, 1986. i 


[105] P. V. Kokotovic, H. K. Khalil, and J. O'Reilly. Singular Perturbations Methods 
in Control: Analysis and Design. Academic Press, New York, 1986. Repub- 
lished by SIAM, 1999. 


[106] M. A. Krasnoselskii and A. V. Pokrovskii. Systems with Hysteresis. Springer- 
Verlag, Berlin, 1989. 

[107] N. N. Krasovskii. Stability of Motion. Stanford University Press, Stanford, 
1963. 


[108] M. Krstic, I. Kanellakopoulos, and P. Kokotovic. Nonlinear and Adaptive 
Control Design, Wiley-Interscience, New York, 1995. 


[109] J. Kurzweil. On the inversion of Lyapunov’s second theorem on stability of 
motion. Trans. Amer. Math. Soc., 24:19 17, 1956. 


[110] H. Kwakernaak and R. Sivan. Linear Optimal Control Systems. Wiley- 
Interscience, New York, 1972. , 


[111] S. Lang. Real and Functional Analysis. Springer-Verlag, New York, third 
edition, 1993. 


[112] J. P. LaSalle. Some extensions of Lyapunov’s second method. IRE Trans. 
Circuit Theory, CT-7:520-527, 1960. 


[113] J. P. LaSalle. An invariance principle in the theory of stability. In J. K. Hale 
and J. P. LaSalle, editors, Differential Equations and Dynamical Systems, 
pages 277-286. Academic Press, New York, 1967. 


[114] D. A. Lawrence and W. J. Rugh. Gain scheduling dynamic linear controllers 
for a nonlinear plant. Automatica, 31:381-390, 1995. 


[115] S. Lefschetz. Differential Equations: Geometric Theory. Wiley-Interscience, 
New York, 1963. 


[116] S. Lefschetz. Stability of Nonlinear Control Systems. Academic Press, New 
York, 1965. 


[117] W. Leonard. Control of Electrical Drives. Springer, Berlin, second edition, 
1996. 


“BIBLIOGRAPHY 733 


[118] Y. Lin, E. Sontag, and Y. Wang. A smooth converse lyapunov theorem for 
robust stability. SIAM J. Contr. Optim., 34:124-160, 1996. 


[119] Z. Lin and A. Saberi. Robust semi-global stabilization of minimum-phase 
input-output linearizable systems via partial state and output feedback. IEEE 
Trans. Automat. Contr., 40:1029-1041, 1995. 


[120] R. Lozano, B. Brogliato, O. Egeland, and B. Maschke. Dissipative Systems 
Analysis and Control: Theory and Applications. Springer, London, 2000. 


[121] D. G. Luenberger. Optimization by Vector Space Methods. Wiley, New York, 
1969. 


[122] D. G. Luenberger. Introduction to Linear and Nonlinear Programming. 
Addison-Wesley, Reading, MA, 1973. 


[123] I. M. Y. Mareels and D. J. Hill. Monotone stability of nonlinear feedback 
systems. J. Mathematical Systems, Estimation and Control, 2:275-291, 1992. 


[124] R. Marino and P. Tomei. Nonlinear Control Design: Geometric, Adaptive & 
Robust. Prentice-Hall, London, 1995. 


[125] J. L. Massera. Contributions to stability theory. Annals. of Mathematics, 
64:182-206, 1956. 


[126] I. D. Mayergoyz. The Preisach Model for Hysteresis. Springer-Verlag, Berlin, 
1991. 


[127] S. M. Meerkov. Principle of vibrational control: Theory and applications. 
IEEE Trans. Automat. Contr., AC-25:755-762, 1980. 


[128] A. I. Mees. Dynamics of Feedback Systems. Wiley, New York, 1981. 


[129] A. I. Mees. Describing functions: ten years on. IMA J. Applied Mathematics, 
32:221—-233, 1984. 


[130] A. I. Mees and A. R. Bergen. Describing functions revisited. IEEE Trans. 
Automat. Contr., AC-20:473-478, 1975. 


[131] A. N. Michel, J. A. Farrel, and W. Porod. Qualitative analysis of neural 
networks. JEEE Trans. Circuits Syst., 36:229-243, 1989. 


[132] A. N. Michel and R. K. Miller. Qualitative Analysis of Large Scale Dynamical 
Systems. Academic Press, New York, 1977. 


[133] A. N. Michel, N. R. Sarabudla, and R. K. Miller. Stability analysis of complex 
dynamical systems. Circuits Systems Signal Process, 1:171-202, 1982. 


[134] R. E. Mickens. Introduction to Nonlinear Oscillations. Cambridge University 
Press, London, 1981. 


734 ` BIBLIOGRAPHY 


[135] R. K. Miller and A. N. Michel. Ordinary Differential Equations. Academic 
Press, New York, 1982. 


[136] R. K. Miller and A. N. Michel. An invariance theorem with applications to 
adaptive control. IEEE Trans. Automat. Contr., 35:744-748, 1990. 


[137] N. Minorsky. Nonlinear Oscillations. Van Nostrand, Princeton, NJ, 1962. 


[138] J. B. Moore and B. D. O. Anderson. Applications of the multivariable Popov 
criterion. Int. J. Control, 5:345-353, 1967. 


[139] K. S. Narendra and A. M. Annaswamy. Stable Adaptive Systems. Prentice- 
Hall, Englewood Cliffs, NJ, 1989. 


[140] K. S. Narendra and J. Taylor. Frequency Domain Methods for Absolute Sta-. 
bility. Academic Press, New York, 1973. 


[141] A. H. Nayfeh. Introduction to Perturbation Techniques. Wiley, New York, 
1981. 


[142] H. Nijmeijer and A. J. van der Schaft. Nonlinear Dynamic Control Systems. 
Springer-Verlag, Berlin, 1990. 


[143] E. Noldus and M. Loccufier. A new trajectory reversing method for the 
estimation of asymptotic stability regions. Int. J. Contr., 61:917-932, 1995. 


[144] H. Olsson. Control Systems with Friction. PhD thesis, Lund Institute of 
Technology, Lund, Sweden, 1996. 


[145] R. E. O'Malley. Singular Perturbation Methods for Ordinary Differential 
Equations. Springer-Verlag, New York, 1991. 


[146] R. Ortega, A. Loria, P. J. Nicklasson, and H. Sira-Ramirez. Passivity-based 
Control of Euler-Lagrange Systems. Springer, London, 1998. 


[147] B. E. Paden and S. S. Sastry. A calculus for computing Filippov’s differential 
inclusion with application to the variable structure control of robot manipu- 
lators. IEEE Trans. Circuits Syst., CAS-34:73-82, 1987. 


[148] M. A. Pai. Power System Stability Analysis by the Direct Method of Lyapunov. 
North-Holland, Amsterdam, 1981. 


[149] T. S. Parker and L. O. Chua. Practical Numerical Algorithms for Chaotic 
Systems. Springer-Verlag, New York, 1989. 


[150] R. V. Patel and M. Toda. Qualitative measures of robustness for multivariable 
systems. In Joint Automatic Control Conference, number TP8-A, 1980. 


[151] W. R. Perkins and J. B. Cruz. Engineering of Dynamic Systems. John Wiley, 
New York, 1969. 


E — P 


RR 


TERN 


BIBLIOGRAPHY 735 


[152] V. M. Popov. Hyperstability of Control Systems. Springer-Verlag, New York, 
1973. 


[153] Z. Qu. Robust Control of Nonlinear Uncertain Systems. Wiley-Interscience, 
New York, 1998. ; 


[154] N. Rouche, P. Habets, and M. Laloy. Stability Theory by Lyapunov's. Direct 
Method. Springer-Verlag, New York, 1977. 


[155] N. Rouche and J. Mawhin. Ordinary Differential Equations. Pitman, Boston, 
1973. 


*. 


[156] H. L. Royden. Real Analysis. Macmillan, New York, 1963. 


[157] W. Rudin. Principles of Mathematical Analysis. McGraw-Hill, New York, 
third edition, 1976. 


[158] W. J. Rugh. Linear System Theory. Prentice-Hall, Upper Saddle River, NJ, 
second edition, 1996. 


[159] W. J. Rugh and J. S. Shamma. Research on gain scheduling. Automatica, 
36:1401-1425, 2000. 


[160] A. Saberi and H. Khalil. Quadratic-type Lyapunov functions for singularly 
perturbed systems. IEEE Trans. Automat. Contr., AC-29:542-550, 1984. 


[161] A. Saberi, P. V. Kokotovic, and H. J. Sussmann. Global stabilization of 
partially linear composite systems. SIAM J. Control & Optimization, 28:1491- 
1503, 1990. 


[162] M. Safonov. Stability and Robustness of Multivariable Feedback Systems. MIT 
Press, Cambridge, MA, 1980. 


[163] F. M. A. Salam. A formulation for the design of neural processors. In Inter- 
national Conference on Neural Networks, pages 1-173-1-180, July 1988. 


[164] I. W. Sandberg. On the L;-boundedness of solutions of nonlinear functional 
equations. Bell Sys. Tech. J., 43:1581-1599, 1964. 


. [165] I. W. Sandberg. Global inverse function theorems. IEEE Trans. Circuits 


Syst., CAS-27:998-1004, 1980. 


[166] J. A. Sanders and F. Verhulst. Averaging Methods in Nonlinear Dynamical 
Systems. Number 59 in Applied Mathematical Sciences. Springer-Verlag, New 
York, 1985. 


[167] S. Sastry. Nonlinear Systems: Analysis, Stability and Control. Springer, New 
York, 1999. 


€€44&€€(£&«&€&éccccccecu 


-— 


2»»5959555555590686202504€ 


Y 


XDS 


A ONE ORD AD X 


DDS IRIS 


7386 BIBLIOGRAPHY 
[168] S. Sastry aud M. Bodson. Adaptive Control. Prentice Hall, Englewood Cliffs, 
NJ, 1989. 


[169] S. Sastry, J. Hauser, and P. Kokotovic. Zero dynamics of regularly perturbed 
systems are singularly perturbed. Systems Contr. Lett., 13:299-314, 1989. 


- [170] P. W. Sauer and M. A. Pai. Power System Dynamics and Stability. Prentice- 


Hall, Upper Saddle River, NJ, 1998. 


[171] L. Sciavicco and B. Siciliano. Modeling and Control of Robot Manipulators. 
McGraw-Hill, New York, 1996. 


[172] R. Sepulchre, M. Jankovic, and P. Kokotovic. Constructive Nonlinear Control. 
Springer, London, 1997. 


[173] D. Shevitz aud B. Paden. Lyapunov stability theory of nonsmooth systems. 
IEEE Trans. Automat. Contr., 39:1910- 1914, 1994. 


[174] D. D. Siljak. Nonlinear Systems. Wiley, New York, 1969. 


[175] D. D. Siljak. Large Scale Dynamic Systems: Stability and Structure. North- 
Holland, New York, 1978. 


[176] H. Sira-Rainirez. Harmonic response of variable-structure-controlled van der 
Pol oscillators. IEEE Trans. Circuits Syst., CAS-34:103 -106, 1987. 


[177] H. Sira-Raunirez. A dynamical variable structure control strategy in asymp- 
totic output tracking problem. IEEE Trans. Automat. Contr., 38:615-620, 
1993. 


[178] G. R. Slemon and A. Straughen. Electric Machines. Addison-Wesley, Reading, 
MA, 1980. 

[179] J. J. E. Slotine and J. K. Hedrick. Robust input-output feedback linearization. 

Int. J. Contr., 57:1133-1139, 1993. 


J. J. E. Slotine and W. Li. Applied Nonlinear Control. Prentice Hall, Engle- 
wood Cliffs, NJ, 1991. 


[180 


[181] E. D. Sontag. Smooth stabilization implies coprime factorization. IEEE Trans. 
- Automat. Contr., 34:435-443, 1989. 


[182] E. D. Sontag. On the input-to-state stability property. European J, Control, 
1, 1995. 


[183] E. D. Sontag and Y. Wang. On characterizations of the input-to-state stability 
property. Systems Contr. Lett., 24:351-359. 1995. 


[184] S. C. Southward. Modeling and Control of Mechanical Systems with Stick-Slip 
Friction. PhD thesis, Michigan State University, East Lansing, 1990. 


BIBLIOGRAPHY 737 


[185] M. W. Spong and M. Vidyasagar. Robot Dynamics and Control. Wiley, New 
York, 1989. 


[186] E. G. Strangas, H. K. Khalil, B. Aloliwi, L. Laubinger, and J. Miller. Robust 

` tracking controllers for induction motors without rotor position sensor: anal- 

ysis and experimental results. IEEE Trans. Energy conversion, 14:1448-1458, 
1999. 


E 


[187] S.H. Strogatz. Nonlinear Dynamics and Chaos. Addison Wesley, Reading, 
MA, 1994. 


[188] H. J. Sussmann and P. V. Kokotovic. The peaking phenomenon and the global 
stabilization of nonlinear systems. JEEE Trans. Automat. Contr., 36:424—440, 
1991. 


[189] F. L. Swern. Analysis of oscillations in systems with polynomial-type nonlin- 
earities using describing functions. IEEE Trans. Automat. Contr., AC-28:31- 
41, 1983. 


[190] G. Tao and P. A. Ioannou. Strictly positive real matrices and the Lefschetz- 
Kalman-Yakubovitch lemma. IEEE Trans. Automat. Contr., 33:1183-1185, 
1988. 


[191] A. Teel and L. Praly. Tools for semiglobal stabilization by partial state and 
output feedback. SIAM J. Control & Optimization, 33, 1995. 


[192] A. R. Teel, T. T. Georgiou, L. Praly, and E. Sontag. Input-output stability. 
In W. Levine, editor, The Control Handbook. CRC Press, 1995. 


[193] A.R. Teel and L. Praly. Results on converse lyapunov functions from class KL 
estimates. In Proc. IEEE Conf. on Decision and Control, pages 2545-2550, 
Phoenix, Arizona, 1999. 


[194] A. N. Tikhonov, A. B. Vasileva, and V. M. Volosov. Ordinary differential 
equations. In E. Roubine, editor, Mathematics Applied to Physics, pages 162- 
228. Springer-Verlag, New York, 1970. 


[195] A. Tonnelier, S. Meignen, H. Bosch, and J. Demongeot. Synchronization and 
desychronization of neural oscillators. Neural Networks, 12:1213-1228, 1999. 


[196] J. Tsinias. Partial-state global stabilization for general triangular systems. 
Systems Contr. Lett., 24:139-145, 1995. 


[197] V. Utkin, J. Guldner, and J. Shi. Sliding Mode Control in Electromechanical 
Systems. Taylor & Francis, London, 1999. 


[198] V. I. Utkin. Sliding Modes in Optimization and Control. Springer-Verlag, 
New York, 1992. 


738 J BIBLIOGRAPHY 


[199] A. van der Schaft. Lo-Gain and Passivity Techniques in Nonlinear Control. 
Springer, London, 2000. 


[200] M. Vidyasagar. Large Scale Interconnected Systems. Springer-Verlag, Berlin, 
1981. 


[201] M. Vidyasagar. Nonlinear Systems Analysis. Prentice-Hall, Englewood Cliffs, 
NJ, second edition, 1993. 


[202] T. L. Vincent and W. J. Grantham. Nonlinear and Optimal Control Systems. 
Wiley-Interscience, New York, 1997. 


[203] A. Visintin. Differential Models of Hysteresis. Springer, Berlin, 1994. 


[204] J.V. Wait, L.P. Huelsman, and G.A. Korn. Introduction to Operational Am- 
plifiers. McGraw-Hill, New York, 1975. 


[205] CJ. Wan, D.S. Bernstein, and V.T. Coppola. Global stabilization of the 
oscillating eccentric rotor. In Proc. IEEE Conf. on Decision and Control, 
pages 4024-4029, Orlando, FL, 1994. . 


[206] J. T. Wen. Time domain and frequency domain conditions for strict positive 
realness. IEEE Trans. Automat. Contr., 33:988-992, 1988. 


[207] S. Wiggins. Introduction to Applied Nonlinear Dynamical Systems and Chaos. 
Springer-Verlag, New York, 1990. 


[208] J. C. Willems. The Analysis of Feedback Systems. MIT Press, Cambridge, 
MA, 1971. 


[209] J. C. Willems. Dissipative dynamical systems, part I: general theory. Arch. 
Rat. Mech. Anal., 45:321-351, 1972. 


[210] J. L. Willems. The computation of finite stability regions by means of open 
Lyapunov surfaces. Int. J. Control, 10:537-544, 1969. 


[211] H. H. Woodson and J. R. Melcher. Electromechanical Dynamics, Part I: 
Discrete Systems. John Wiley, New York, 1968. 


[212] F. F. Wu and C. A. Desoer. Global inverse function theorem. IEEE Trans. 
Circuit Theory, CT-19:199-201, 1972. 


[213] T. Yoshizawa. Stability Theory By Liapunov’s Second Method. The Mathe- 
matical Society of Japan, Tokyo, 1966. 


[214] D. C. Youla. On the factorization of rational matrices. [RE Trans. Information 
Theory, IT-7:172-189, 1961. 


[215] K. D. Young, V. I. Utkin, and U. Ozguner. A control engineer's guide to 
sliding mode control. IEEE Trans, Contr. Syst. Tech., 7:328-342, 1999. 


BIBLIOGRAPHY 739 


[216] J. Zaborszky, G. Huang, B. Zheng, and T. C. Leung. On the phase portrait 
of a class of large nonlinear dynamic systems such as the power system. IEEE 
Trans. Automat. Contr., 33:4-15, 1988. 


[217] G. Zames. On the input-output stability of nonlinear time-varying feedback 
systems, part IL. IEEE Trans. Automat. Contr., AC-11:228-238, 1966. 


[218] G. Zames. On the input-output stability of nonlinear time-varying feedback 
systems, part II. JEEE Trans. Automat. Contr., AC-11:465-477, 1966. 


. [219] G. Zames. Feedback and optimal sensitivity: model reference transformations, 


multiplicative seminorms, and approximate inverses. IEEE Trans. Automat. 
Contr., AC-26:301-320, 1981. 


[220] K. Zhou, J. C. Doyle, and K. Glover. Robust and Optimal Control. Prentice 


Hall, Upper Saddle River, NJ, 1996. 


[221] V. I. Zubov. Methods of A.M. Lyapunov and Their Application. Noordhoff, 
Groningen, The Netherlands, 1964. 


| 


(W*Y*PPPPRPPRPPRPPPPPPPPTPPFOeEFFOFFFFVFV(V(?FFwWV 


ape 
- 


Y 


Symbols! 


Q ol 


a 
- 


V 


MELL ama% YY 


ƏM 
dist(p, M) 


f:91— S 


identically equal 
approximately equal 


defined as 

less (greater) than 

less (greater) than or equal to 
much less (greater) than 

for all 

belongs to 

subset of 

tends to 

implies 

equivalent to, if and only if 
summation 

product 

the absolute value of a scalar a 
the norm of a vector z (647) 
the p-norm of a vector x (647) 


the induced p-norm of a matrix A (648) 


maximum 
minimum 


supremum, the least upper bound 
infimum, the greatest lower bound 
the n-dimensional Euclidean space (647) 


the ball {xz € R^ | jell <r} 
the closure of a set M 

the boundary of a set M 

the distance from a point p to 
a set M (127) 


H 
a function f mapping a set S into 


a set S3 (649) 


'The page where the symbol is define: is given in parentheses. 
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ad$g 
diag[ai, ... , as] 


block diag[Ai,..., An] 


| At (z7) 


Amax(P) (Amin (P)) 


P>0 
P>0 
Re[z] or Re z 
Im[z] or Im z 
Z or z* 
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the composition of two functions (650) 

the inverse of a function f (650) 

the first derivative of a real-valued function f (650) 
the upper right-hand derivative (659) 

the gradient vector (650) 

the Jacobian matrix (651) 

the first derivative of y with respect to time 
the second derivative of y with respect to time 
the ith derivative of y with respect to time — " 
the Lie derivative of h with respect to 

the vector field f (510) 

the Lie bracket of the vector fields f and g (523) 
[/, ad g| (523) 

a diagonal matrix with diagonal 

elements a; to an 

& block diagonal matrix with diagonal 

blocks A; to Ay 

the transpose of a matrix A ( a vector z) 

the maximum (minimum) eigenvalue of 

a symmetric matrix P 

a positive definite matrix P (117) 

a positive semidefinite matrix P (117) 

the real part of a complex variable z 

the imaginary part of a complex variable z 
the conjugate of a complex variable z 

the conjugate of a complex matrix Z 

the saturation function (19) 

the signum function (19) 

order of magnitude notation (383) 

designation of the end of theorems, lemmas 
and corollaries 

designation of the end of examples 
designation of the end of proofs 

see reference number xx in the bibliography 
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theorems, 114, 128, 139, 307, 
452 
of invariant set, 332 
region of, 122 
uniform 
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Automotive suspension, 429 
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application to weakly noulinear 
oscillators, 411 
general, 415 


Backlash, 22 

Backstepping, 589 

Banach space, 654 

Barbalat’s lemma, 323 

Barbashin-Krasovskii theorems, 124, 
128 

Basin, 122 


Behavior 
global, 3 
local, 3 
multiple modes of, 4 
qualitative, 36 
quantitative, 36 
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Coulomb friction, 9, 81 
Cruise control, 79 


DC motor, 30 
armature-controlled, 31, 425 
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Derivative approximator, 495, 618 
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Discrete-time system, 193 

Dissipative system, 262 

Distribution, 524 
involutive, 524 

Domain, 649 

Domain of attraction, 122 


743. 


Duffing's equation, 10, 172, 422 
Dynamic multiplier, 255 
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stabilization, see stabilization 
state, 469 
static, 470 
tracking, 474, 540, 572 
Feedback linearizable system, 505 
characterization, 525 
definition, 508 
Feedback passivation, 607 
Feedback system 
analysis of, 217, 245 
frequency domain, 263 
high-gain, 426, 460, 569, 586, 600 
well-defined, 217, 246 
Finite escape time, 3, 93 
Fixed point of a mapping, 653 
Floquet theory, 189 
Friction, 9 
Coulomb, 9, 81 
negative, 27 
static, 9 
viscous, 9 
Frobenius theorem, 710 
Full-state linearization, 521 
Functions 
composition of, 650 
continuous, 649 
piecewise, 650 
uniformly, 649 
differentiable, 650 
inverse of, 650 
one-to-one, 650 


Gain scheduling, 485 
Gradient system, 185 
Gradient. vector, 650 
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Ho. control, 209, 475 
H norm, 210 


Hamilton-Jacobi-Bellman equation, 186 


Hamilton Jacobi inequality, 212 
Hardening spring, 9 
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equation, 282 

method of, 280 
High-gain feedback, 426, 460, 569, 586, 

600 

High-gain observer, 495, 610 

reduced-order, 618 
Hopfield model, 14, 80 
Hurwitz 

matrix, 135 

transfer function, 238 
Hydraulic system, 32, 33, 485 
Hysteresis, 20, 49 


Identification, 422 
Implicit function theorem, 651 
Index method, 68 
Induction motor, 638 
Inequality 

Cauchy-Schwartz, 377 

Hólder's, 90, 200 

triangle, 647 

Young's, 466 
Infimum, 648 i 
Inner product, 647 
Input-feedforward passive, 232, 236 
Input-output linearization, 509 
Input-output stability, 195 
Input-state linearization, 508 
Input strictly passive, 232, 236 
Input-to-state stability, 

definition, 175 

, local, 192 

theorem, 176 
Instability of equilibrium point 

definition, 112 

theorems, 125, 139, 183 
Integral control, 379, 478, 481, 490, 

575, 623 

robustness of, 481 
Integrator backstepping, 589 
Interconnected systems, 179, 358 
Internal model principle, 474 
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Invariance-like theorems, 323, 325 
Invariance principle, 126 
Invariant set, 127 

positively, 127 
Inverted pendulum, 28, 503, 545 
ISS, 176 


Jacobian matrix, 52, 651 
Josephson junction, 26 
Jump phenomena, 58 


Kalman-Yakubovich-Popov lemma, 240 


Krasovskii's method, 183 


L£ stability : 
connection with passivity, 241 
definition, 197 
finite-gain, 197 
of state models, 201 
small-signal, 201 
theorems, 202, 206, 208 

Le gain, 209 

Lp space, 196 

LaSalle’s theorem, 128 

Lemma, See Lemma Index, 750 

Level surface, 116 

Lie bracket, 523 

Lie derivative, 510 

Liénard’s equation, 13, 184 


^ Limit cycles, 4, 54 


Limit set, 127 
Linear growth condition, 532 
Linear system 
time-invariant, 133 
time-varying, 156, 189, 326, 354, 
372, 407, 418 
Linear vector space, 653 
normed, 653 
Linearization, 51, 139, 161, 165, 194, 
475 
equivalent, 283 
exact, 505 
Lipschitz 
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_ condition, 87, 88, 89, 93, 94. 96 
globally, 89 
locally, 89 
Loop transformation, 255 
Lossless system, 232, 236 
Lure's problem, 264 
Lyapunov equation, 136, 185, 370, 372 
Lyapunov function, 116 
' composite, 359, 451 
energy, 113 
energy-like, 129 
existence of, see Converse theo- 
rems 
Lure-type, 276 
quadratic, 117 
quadratic-type, 345 
searching for 
interconnected systems, 358 
Krasovskii's method, 183 
linearization, 142 
Lyapunov equation, 136 
singularly perturbed systems, 
449, 465 
variable gradient method, 120 
Lyapunov redesign, 579 
Lyapunov stability, 111 
autonomous systems, 112 
connection with input-output sta- 
bility, 202 
connection with passivity, 241 
nonautonomous systems, 147 
Lyapunov surface, 116 
Lyapunov's first (second) instability 
theorem, 183 
Lyapunov's indirect method, 139, 161 
Lyapunov's stability theorem, 114 


M-matrix, 360 
Magnetic levitation, see magnetic sus- 
pension 


. Magnetic suspension system, 31, 501, 


549, 635 
Manifold, 304 
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center, 305 
approximation of, 309 
fast, 445 
invariant, 304 
sliding, 553 
slow, 444 
approximation of, 444 
Mass-spring system, 8, 27, 81, 184 
Massera's lemma, 665 
Matching condition, 538, 551 
Mathieu's equation, 420 
Mean value theorem, 651 
Memoryless function, 18 
Min-max control, 723 
Minimum phase systems 
linear, 515 
nonlinear, 517 


Negative definite function, 117, 154 
Negative semidefinite function, 117 
Neighborhood, 649 

Neural network, 14, 80, 131, 362 
Nonautonoinous system, 3 
Nonlinear damping, 539, 588 


Nonlinear phenomena, essentially, 3. - 


Nonlinearity . 
backlash, 22 
dead-zone, 20 
hysteresis, 20 
memoryless, 18 
piecewise-linear, 283 
quantization, 20 
saturation, 19 
sector, 232 
sigmoid, 15 
signum, 19 

static, 18 

zero-memory, 18 

Norm, 196, 647, 653 
induced matrix, 648 
vector, 647, 653 

Normal form, 517 
special, 547, 596 


INDEX 


Normed linear space, 653 


Observer-based controller, 472, 477. 
611 
Orbit, 35 
periodic (closed), 55 
Oscillation, 54 
almost-periodic, 4 
harmonic, 4 
relaxation, 58 - 
subharmonic, 4 
Oscillator 
chemical, 85 
harmonic, 55, 62 
negative resistance, 11, 56, 63, 79 
Van der Pol, 13, 57, 413, 445, 626 
Wien-bridge, 80 
Output equation, 2 
Output-feedback passive, 232, 236 
Output strictly passive, 232, 236 


Parasitic parameters, 424 
Parseval's theorem, 210 
Passive system, 230 
Passivity, 227, 236 
Passivity-based control, 604 
Passivity theorems, 245 
Peaking phenomenon, 534, 613 
Pendulum equation, 5, 27, 37, 49, 53, 
113, 118, 126, 143, 188, 409, 
476, 482, 505, 536, 542, 556, 
586, 627, 637 
inverted, 28, 503, 545 
Periodic orbit, 55 
stability of, 331 
Periodic solution (nontrivial), 55 
Persistence of excitation, 329 
Persistent disturbance, 707 
Perturbation 
nonvanishing, 346 
periodic, 397 
structured, 344 
unstructured, 344 


INDEX 


vanishing, 340 
Perturbation method, 382 
justification of, 388 
on the infinite interval, 393 
Phase-locked loop, 26, 100 
Phase plane, 35 
Phase portrait, 36, 59 
Piecewise linear analysis, 11 
Poincaré-Bendixson theorem, 61 
Poincaré index, 68 
Poincaré map, 398 
Popov criterion, 275, 298 
multivariable, 276 
Popov plot, 278 
Positive definite function, 117, 154 
Positive limit point (set), 127 
Positive real lemma, 240 
Positive real transfer function, 237 
strictly, 238 
Positive semidefinite function, 117 
Prey-predatory system, 82 
Proper map, 508 


Quasi-steady-state 1nodel, 424 


Radially unbounded function, 123, 154 
Raleigh’s equation, 287, 421 
Reaching phase, 553 
Reduced system (model), 306, 424 
Reduction principle, 307 
Region, 649 
Region of attraction (asymptotic sta- 
bility), 122, 312, 335 
estimate of, 316 
Regular form, 564 
Regulation, 474 
see integral control 
Relative degree 
linear systems, 238, 512 
nonlinear systems, 510 
Riccati equation, 185, 261, 373 
RLC circuit, 188, 233, 391, 427, 440, 
460 
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Robot manipulator, 24, 184, 260, 527, 
606, 640 

Robustness, 34, 219, 347, 441, 459, 
535, 551, 566, 580, 598 

Rotating rigid body (spacecraft), 181, 
260, 608 


Saddle, 40, 52, 60 
Saturation function, 19 
Scheduling variables, 485 
Second-order system, 35, 411 
Sector condition (nonlinearity), 232 
Sensitivity, 99 
Separation principle, 611 
Separatrix, 47 
Set, 649 
boundary point of, 649 
closed, 649, 654 
closure of, 649 
compact, 649 
connected, 649 
simply, 67 
interior of, 649 
. open, 649 
Sigmoid function, 15 
Signum function, 19 
Singular perturbation method, 59, 423 
Singularly perturbed systems, 45 
linear, 462, 463 
multiparameter, 466 
stability analysis of, 449 
standard model, 424 
Sliding mode control, 551 
continuous, 558, 566 
Sliding manifold, 553 
Sliding phase, 553 
Slow manifold, 444 
Slow mode, 435 
Slow model, 424 
Slowly varying system, 365 
Small-gain theorem, 217 
Softening spring, 9 
Spectral factorization, 681 
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Stability 


absolute, 264 
with a finite domain, 265 
asymptotic, 112, 149 
exponential, 150, 154 
input-output, 195 
input-to-state, 175 
£, 197 
Lyapunov, 111 
matrix, 135 
of discrete-time system, 193 
of equilibrium point 
definition, 112, 149 
theorems, 114, 134, 151 
of invariant set, 331 
of linear system, 133, 156 
of periodic orbit, 331 
of periodic solution, 329, 333 
of perturbed system, 339 
preserving map, 140 
total, 721 
uniform, 149 


Stabilization, 470 


global, 473, 532 

local, 473 

regional, 473 

robust, 551 

semiglobal, 473 

via backstepping, 589 

via exact linearization, 530 


via high-gain feedback, 569, 586, 


600 
via linearization, 475 
via Lyapunov redesign, 579 


via output feedback, 472, 610, 619 
via passivity-based control, 604 


via sliding mode control, 563 


Stable 


equilibrium point, 112 
focus, 40, 41, 52 

limit cycle, 58 

node, 38, 41, 52, 54 
structurally, 45, 55 


State equation, 2 
unforced, 2 
State (-space) model, 2 
State plane, 35 
State strictly passive, 235 
Storage function, 236 
Stribeck effect, 10 
Strict feedback form, 595 
Strictly passive, 236 
Successive approximation, 653, 655 
Supremum, 648 
Synchronous generator, 25, 544 


Taylor series, 384 
‘Theorem, see Theorem Index, 750 
Tikhonov’s theorem, 434 
on the infinite interval, 439 
Time-scale-structure, multiple, 
see averaging and singular per- 
turbation methods 
TORA system, 29, 43 
Tracking, 474, 540, 572 
Trajectory, 35 
closed, 55 
Translational oscillator with rotating 
actuator, 29, 43 
Tunnel diode circuit, 6, 46, 52, 73, 80 


Ultimate boundedness 
definition, 169 
theorem, 172 
Underwater vehicle, 626 
Unmodeled fast dynamics, 219, 441, 
459, 556 
Unstable 
equilibrium point, 112, 149 
focus, 40, 52 
limit cycle, 58 
node 38, 41, 52, 54 . 


Van der Pol equation, 13, 57, 387, 
390. 413, 445, 511, 518, 626 
Variable gradient method, 120 
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Variable structure control, see sliding 
mode control 

Vector field, 35, 509 

Vector field diagram, 36 

‘Vector space, 653 


Zero dynamics, 517 
Zero-state observable, 243 
Zubov's theorem, 335 
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Corollary Index: 


2.1 (68) 4.1 (128) 
5.3 (208) 5.4 (214) 


Lemma Index 


2.1 (61) 2.2 (67) 
3.4 (102) — 41 (127) 
4.6 (176) 4.7 (180) 
6.3 (240) — 6.4 (241) 
7.1 (292). 8.1(314) © 
9.4 (352) ` 9.5 (353) 


10.1(398) 10.2 (399) 
13.4 (537) — 14.1 (589) 


Theorem Index 


3.1 (88) ^" 3.2 (93) 
4.2 (124) 4.3 (125) 
4.8 (151) 4.9 (152) 
4.14 (162) . 4.15 (165) 
5.1 (202) — 5.2 (206) 
6.1(247) 6.2 (248) 
7.2 (270) 7.3 (276) 
8.4 (323) 8.5 (325) 
10.2 (393) 10.3 (401) 
11.3 (452) 114 (456) 
14.1 (568) 14.2 (568) 


10.3 (400) 
14.2 (592) 


3.3 (94) 

4.4 (128). 
4.10 (154) 
4.16 (167) 


12.1 (494) 
14.3 (584) 


14.3 (600) 


3.4 (96) 
4.5 (134) 
4.11 (156) 
4.17 (167) 


12.2 (496) 
14.4 (604) 


5.1 (205) 
9.1 (352) 


3.2 (90) 
4.4 (145) 
6.1 (238) 
6.7 (243) 
9.2 (347) 
9.8 (368) 
13.2 (532) 


3.5 (97) 
4.6 (136) 
4.12 (158) 
4.18 (172) 
5.5 (211) 
6.5 (253) 
8.2 (307) 
9.3 (367) 
11.1 (434) 
13.1 (516) 
14.5 (610) 


INDEX 


5.2 (205) 
14.1 (585) 


13.3 (535) 


4.1 (114) 
4.7 (139) 
4.13 (161) 
4.19 (176) 
5.6 (218) 
7.1 (265) 
8.3 (309) 
10.1 (388) 
11.2 (439) 
13.2 (525) 
14.6 (622) 


12.1 (68) means Corollary 2.1 appears on page 68. The Lemma and Theorem Indexes are 


written similarly. 
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